@bugzy-ai/bugzy 1.12.4 → 1.13.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/dist/cli/index.cjs +62 -12
- package/dist/cli/index.cjs.map +1 -1
- package/dist/cli/index.js +62 -12
- package/dist/cli/index.js.map +1 -1
- package/dist/index.cjs +62 -12
- package/dist/index.cjs.map +1 -1
- package/dist/index.js +62 -12
- package/dist/index.js.map +1 -1
- package/dist/tasks/index.cjs +6 -2
- package/dist/tasks/index.cjs.map +1 -1
- package/dist/tasks/index.js +6 -2
- package/dist/tasks/index.js.map +1 -1
- package/package.json +1 -1
package/dist/cli/index.cjs
CHANGED
|
@@ -1269,7 +1269,9 @@ Extract the following from arguments:
|
|
|
1269
1269
|
"read-knowledge-base",
|
|
1270
1270
|
// Step 5: Test Execution Strategy (library)
|
|
1271
1271
|
"read-test-strategy",
|
|
1272
|
-
// Step 6:
|
|
1272
|
+
// Step 6: Clarification Protocol (library)
|
|
1273
|
+
"clarification-protocol",
|
|
1274
|
+
// Step 7: Identify Tests (inline - task-specific)
|
|
1273
1275
|
{
|
|
1274
1276
|
inline: true,
|
|
1275
1277
|
title: "Identify Automated Tests to Run",
|
|
@@ -1495,7 +1497,9 @@ Store the detected trigger for use in output routing:
|
|
|
1495
1497
|
- Set variable: \`TRIGGER_SOURCE\` = [GITHUB_PR | SLACK_MESSAGE | CI_CD | MANUAL]
|
|
1496
1498
|
- This determines output formatting and delivery channel`
|
|
1497
1499
|
},
|
|
1498
|
-
// Step 6:
|
|
1500
|
+
// Step 6: Clarification Protocol (library)
|
|
1501
|
+
"clarification-protocol",
|
|
1502
|
+
// Step 7: Extract Context (inline)
|
|
1499
1503
|
{
|
|
1500
1504
|
inline: true,
|
|
1501
1505
|
title: "Extract Context Based on Trigger",
|
|
@@ -6606,6 +6610,16 @@ Determine exploration depth based on requirement quality:
|
|
|
6606
6610
|
- **Vague:** "Fix the sorting in todo list page. The items are mixed up for premium users."
|
|
6607
6611
|
- **Unclear:** "Improve the dashboard performance. Users say it's slow."
|
|
6608
6612
|
|
|
6613
|
+
### Maturity Adjustment
|
|
6614
|
+
|
|
6615
|
+
If the Clarification Protocol determined project maturity, adjust exploration depth:
|
|
6616
|
+
|
|
6617
|
+
- **New project**: Default one level deeper than requirement clarity suggests (Clear \u2192 Moderate, Vague \u2192 Deep)
|
|
6618
|
+
- **Growing project**: Use requirement clarity as-is (standard protocol)
|
|
6619
|
+
- **Mature project**: Trust knowledge base \u2014 can stay at suggested depth or go one level shallower if KB covers the feature
|
|
6620
|
+
|
|
6621
|
+
**Always verify features exist before testing them.** If exploration reveals that a referenced page or feature does not exist in the application, this is CRITICAL severity \u2014 escalate via the Clarification Protocol regardless of maturity level. Do NOT silently adapt or work around the missing feature.
|
|
6622
|
+
|
|
6609
6623
|
### Quick Exploration (1-2 min)
|
|
6610
6624
|
|
|
6611
6625
|
**When:** Requirements CLEAR
|
|
@@ -6838,6 +6852,33 @@ Before starting, check if this task is resuming from a blocked clarification:
|
|
|
6838
6852
|
|
|
6839
6853
|
3. **If no clarification in $ARGUMENTS:** Proceed normally with ambiguity detection below.
|
|
6840
6854
|
|
|
6855
|
+
### Assess Project Maturity
|
|
6856
|
+
|
|
6857
|
+
Before detecting ambiguity, assess how well you know this project. Maturity determines how aggressively you should ask questions \u2014 new projects require more questions, mature projects can rely on accumulated knowledge.
|
|
6858
|
+
|
|
6859
|
+
**Measure maturity from runtime artifacts:**
|
|
6860
|
+
|
|
6861
|
+
| Signal | New | Growing | Mature |
|
|
6862
|
+
|--------|-----|---------|--------|
|
|
6863
|
+
| \`knowledge-base.md\` | < 80 lines (template) | 80-300 lines | 300+ lines |
|
|
6864
|
+
| \`memory/\` files | 0 files | 1-3 files | 4+ files, >5KB each |
|
|
6865
|
+
| Test cases in \`test-cases/\` | 0 | 1-6 | 7+ |
|
|
6866
|
+
| Exploration reports | 0 | 1 | 2+ |
|
|
6867
|
+
|
|
6868
|
+
**Steps:**
|
|
6869
|
+
1. Read \`.bugzy/runtime/knowledge-base.md\` and count lines
|
|
6870
|
+
2. List \`.bugzy/runtime/memory/\` directory and count files
|
|
6871
|
+
3. List \`test-cases/\` directory and count \`.md\` files (exclude README)
|
|
6872
|
+
4. Count exploration reports in \`exploration-reports/\`
|
|
6873
|
+
5. Classify: If majority of signals = New \u2192 **New**; majority Mature \u2192 **Mature**; otherwise \u2192 **Growing**
|
|
6874
|
+
|
|
6875
|
+
**Maturity adjusts your question threshold:**
|
|
6876
|
+
- **New**: Ask for CRITICAL + HIGH + MEDIUM severity (gather information aggressively)
|
|
6877
|
+
- **Growing**: Ask for CRITICAL + HIGH severity (standard protocol)
|
|
6878
|
+
- **Mature**: Ask for CRITICAL only (handle HIGH with documented assumptions)
|
|
6879
|
+
|
|
6880
|
+
**CRITICAL severity ALWAYS triggers a question, regardless of maturity level.**
|
|
6881
|
+
|
|
6841
6882
|
### Detect Ambiguity
|
|
6842
6883
|
|
|
6843
6884
|
Scan for ambiguity signals:
|
|
@@ -6864,8 +6905,8 @@ If ambiguity is detected, assess its severity:
|
|
|
6864
6905
|
|
|
6865
6906
|
| Severity | Characteristics | Examples | Action |
|
|
6866
6907
|
|----------|----------------|----------|--------|
|
|
6867
|
-
| **CRITICAL** | Expected behavior undefined/contradictory; test outcome unpredictable; core functionality unclear; success criteria missing; multiple interpretations = different strategies | "Fix the issue" (what issue?), "Improve performance" (which metrics?), "Fix sorting in todo list" (by date? priority? completion status?) | **STOP** -
|
|
6868
|
-
| **HIGH** | Core underspecified but direction clear; affects majority of scenarios; vague success criteria; assumptions risky | "Fix ordering" (sequence OR visibility?), "Add validation" (what? messages?), "Update dashboard" (which widgets?) | **STOP** -
|
|
6908
|
+
| **CRITICAL** | Expected behavior undefined/contradictory; test outcome unpredictable; core functionality unclear; success criteria missing; multiple interpretations = different strategies; **referenced page/feature does not exist in the application** | "Fix the issue" (what issue?), "Improve performance" (which metrics?), "Fix sorting in todo list" (by date? priority? completion status?), "Test the Settings page" (no Settings page exists), "Verify the checkout flow" (no checkout page found) | **STOP** - You MUST ask via team-communicator before proceeding |
|
|
6909
|
+
| **HIGH** | Core underspecified but direction clear; affects majority of scenarios; vague success criteria; assumptions risky | "Fix ordering" (sequence OR visibility?), "Add validation" (what? messages?), "Update dashboard" (which widgets?) | **STOP** - You MUST ask via team-communicator before proceeding |
|
|
6869
6910
|
| **MEDIUM** | Specific details missing; general requirements clear; affects subset of cases; reasonable low-risk assumptions possible; wrong assumption = test updates not strategy overhaul | Missing field labels, unclear error message text, undefined timeouts, button placement not specified, date formats unclear | **PROCEED** - (1) Moderate exploration, (2) Document assumptions: "Assuming X because Y", (3) Proceed with creation/execution, (4) Async clarification (team-communicator), (5) Mark [ASSUMED: description] |
|
|
6870
6911
|
| **LOW** | Minor edge cases; documentation gaps don't affect execution; optional/cosmetic elements; minimal impact | Tooltip text, optional field validation, icon choice, placeholder text, tab order | **PROCEED** - (1) Mark [TO BE CLARIFIED: description], (2) Proceed, (3) Mention in report "Minor Details", (4) No blocking/async clarification |
|
|
6871
6912
|
|
|
@@ -6966,18 +7007,26 @@ Tasks waiting for clarification responses.
|
|
|
6966
7007
|
|
|
6967
7008
|
### Wait or Proceed Based on Severity
|
|
6968
7009
|
|
|
6969
|
-
**
|
|
6970
|
-
-
|
|
6971
|
-
-
|
|
7010
|
+
**Use your maturity assessment to adjust thresholds:**
|
|
7011
|
+
- **New project**: STOP for CRITICAL + HIGH + MEDIUM
|
|
7012
|
+
- **Growing project**: STOP for CRITICAL + HIGH (default)
|
|
7013
|
+
- **Mature project**: STOP for CRITICAL only; handle HIGH with documented assumptions
|
|
7014
|
+
|
|
7015
|
+
**When severity meets your STOP threshold:**
|
|
7016
|
+
- You MUST call team-communicator (Slack) to ask the question \u2014 do NOT just mention it in your text output
|
|
7017
|
+
- Do NOT create tests, run tests, or make assumptions about the unclear aspect
|
|
7018
|
+
- Do NOT silently adapt by working around the issue (e.g., running other tests instead)
|
|
7019
|
+
- Do NOT invent your own success criteria when none are provided
|
|
7020
|
+
- Register the blocked task and wait for clarification
|
|
6972
7021
|
- *Rationale: Wrong assumptions = incorrect tests, false results, wasted time*
|
|
6973
7022
|
|
|
6974
|
-
**
|
|
7023
|
+
**When severity is below your STOP threshold \u2192 Proceed with Documented Assumptions:**
|
|
6975
7024
|
- Perform moderate exploration, document assumptions, proceed with creation/execution
|
|
6976
7025
|
- Ask clarification async (team-communicator), mark results "based on assumptions"
|
|
6977
7026
|
- Update tests after clarification received
|
|
6978
7027
|
- *Rationale: Waiting blocks progress; documented assumptions allow forward movement with later corrections*
|
|
6979
7028
|
|
|
6980
|
-
**LOW \u2192 Proceed and Mark:**
|
|
7029
|
+
**LOW \u2192 Always Proceed and Mark:**
|
|
6981
7030
|
- Proceed with creation/execution, mark gaps [TO BE CLARIFIED] or [ASSUMED]
|
|
6982
7031
|
- Mention in report but don't prioritize, no blocking
|
|
6983
7032
|
- *Rationale: Details don't affect strategy/results significantly*
|
|
@@ -7005,11 +7054,12 @@ When reporting test results, always include an "Ambiguities" section if clarific
|
|
|
7005
7054
|
|
|
7006
7055
|
## Remember
|
|
7007
7056
|
|
|
7008
|
-
- **
|
|
7057
|
+
- **STOP means STOP** - When you hit a STOP threshold, you MUST call team-communicator to ask via Slack. Do NOT silently adapt, skip, or work around the issue
|
|
7058
|
+
- **Non-existent features = CRITICAL** - If a page, component, or feature referenced in the task does not exist, this is always CRITICAL severity \u2014 ask what was meant
|
|
7009
7059
|
- **Ask correctly > guess poorly** - Specific questions lead to specific answers
|
|
7010
|
-
- **
|
|
7060
|
+
- **Never invent success criteria** - If the task says "improve" or "fix" without metrics, ask what "done" looks like
|
|
7011
7061
|
- **Check memory first** - Avoid re-asking previously answered questions
|
|
7012
|
-
- **
|
|
7062
|
+
- **Maturity adjusts threshold, not judgment** - Even in mature projects, CRITICAL always triggers a question`,
|
|
7013
7063
|
tags: ["clarification", "protocol", "ambiguity"]
|
|
7014
7064
|
};
|
|
7015
7065
|
|