agentic-qe 3.7.16 → 3.7.17
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude/agents/v3/qe-devils-advocate.md +20 -0
- package/.claude/agents/v3/qe-gap-detector.md +25 -0
- package/.claude/agents/v3/qe-quality-gate.md +8 -0
- package/.claude/agents/v3/qe-requirements-validator.md +25 -0
- package/.claude/agents/v3/subagents/qe-code-reviewer.md +11 -0
- package/.claude/agents/v3/subagents/qe-integration-reviewer.md +11 -0
- package/.claude/agents/v3/subagents/qe-performance-reviewer.md +11 -0
- package/.claude/agents/v3/subagents/qe-security-reviewer.md +11 -0
- package/.claude/helpers/adr-compliance.sh +10 -10
- package/.claude/helpers/auto-memory-hook.mjs +24 -9
- package/.claude/helpers/brain-checkpoint.cjs +55 -145
- package/.claude/helpers/ddd-tracker.sh +2 -2
- package/.claude/helpers/guidance-hooks.sh +2 -2
- package/.claude/helpers/hook-handler.cjs +57 -18
- package/.claude/helpers/statusline.cjs +414 -595
- package/.claude/helpers/v3/quality-criteria/evidence-classification.md +116 -116
- package/.claude/helpers/v3/quality-criteria/htsm-categories.md +139 -139
- package/.claude/skills/README.md +8 -11
- package/.claude/skills/brutal-honesty-review/SKILL.md +3 -0
- package/.claude/skills/code-review-quality/SKILL.md +3 -0
- package/.claude/skills/qcsd-cicd-swarm/SKILL.md +79 -2075
- package/.claude/skills/qcsd-cicd-swarm/steps/01-flag-detection.md +62 -0
- package/.claude/skills/qcsd-cicd-swarm/steps/02-core-agents.md +33 -0
- package/.claude/skills/qcsd-cicd-swarm/steps/03-batch1-results.md +21 -0
- package/.claude/skills/qcsd-cicd-swarm/steps/04-conditional-agents.md +23 -0
- package/.claude/skills/qcsd-cicd-swarm/steps/05-decision-synthesis.md +30 -0
- package/.claude/skills/qcsd-cicd-swarm/steps/06-report-generation.md +17 -0
- package/.claude/skills/qcsd-cicd-swarm/steps/07-learning-persistence.md +27 -0
- package/.claude/skills/qcsd-cicd-swarm/steps/08-deployment-advisor.md +25 -0
- package/.claude/skills/qcsd-cicd-swarm/steps/09-final-output.md +16 -0
- package/.claude/skills/qcsd-development-swarm/SKILL.md +79 -2027
- package/.claude/skills/qcsd-development-swarm/steps/01-flag-detection.md +50 -0
- package/.claude/skills/qcsd-development-swarm/steps/02-core-agents.md +29 -0
- package/.claude/skills/qcsd-development-swarm/steps/03-batch1-results.md +14 -0
- package/.claude/skills/qcsd-development-swarm/steps/04-conditional-agents.md +23 -0
- package/.claude/skills/qcsd-development-swarm/steps/05-decision-synthesis.md +30 -0
- package/.claude/skills/qcsd-development-swarm/steps/06-report-generation.md +16 -0
- package/.claude/skills/qcsd-development-swarm/steps/07-learning-persistence.md +25 -0
- package/.claude/skills/qcsd-development-swarm/steps/08-defect-predictor.md +25 -0
- package/.claude/skills/qcsd-development-swarm/steps/09-final-output.md +16 -0
- package/.claude/skills/qcsd-ideation-swarm/SKILL.md +94 -1894
- package/.claude/skills/qcsd-ideation-swarm/steps/01-flag-detection.md +57 -0
- package/.claude/skills/qcsd-ideation-swarm/steps/02-core-agents.md +29 -0
- package/.claude/skills/qcsd-ideation-swarm/steps/03-batch1-results.md +15 -0
- package/.claude/skills/qcsd-ideation-swarm/steps/04-conditional-agents.md +23 -0
- package/.claude/skills/qcsd-ideation-swarm/steps/05-decision-synthesis.md +29 -0
- package/.claude/skills/qcsd-ideation-swarm/steps/06-report-generation.md +18 -0
- package/.claude/skills/qcsd-ideation-swarm/steps/07-learning-persistence.md +29 -0
- package/.claude/skills/qcsd-ideation-swarm/steps/08-final-output.md +18 -0
- package/.claude/skills/qcsd-production-swarm/SKILL.md +88 -2663
- package/.claude/skills/qcsd-production-swarm/steps/01-flag-detection.md +206 -0
- package/.claude/skills/qcsd-production-swarm/steps/02-core-agents.md +428 -0
- package/.claude/skills/qcsd-production-swarm/steps/03-batch1-results.md +101 -0
- package/.claude/skills/qcsd-production-swarm/steps/04-conditional-agents.md +125 -0
- package/.claude/skills/qcsd-production-swarm/steps/05-decision-synthesis.md +136 -0
- package/.claude/skills/qcsd-production-swarm/steps/06-report-generation.md +181 -0
- package/.claude/skills/qcsd-production-swarm/steps/07-learning-persistence.md +185 -0
- package/.claude/skills/qcsd-production-swarm/steps/08-feedback-loop.md +122 -0
- package/.claude/skills/qcsd-production-swarm/steps/09-final-output.md +140 -0
- package/.claude/skills/qcsd-refinement-swarm/SKILL.md +59 -2312
- package/.claude/skills/qcsd-refinement-swarm/steps/01-flag-detection.md +91 -0
- package/.claude/skills/qcsd-refinement-swarm/steps/02-core-agents.md +40 -0
- package/.claude/skills/qcsd-refinement-swarm/steps/03-batch1-results.md +40 -0
- package/.claude/skills/qcsd-refinement-swarm/steps/04-conditional-agents.md +35 -0
- package/.claude/skills/qcsd-refinement-swarm/steps/05-decision-synthesis.md +43 -0
- package/.claude/skills/qcsd-refinement-swarm/steps/06-report-generation.md +42 -0
- package/.claude/skills/qcsd-refinement-swarm/steps/07-learning-persistence.md +53 -0
- package/.claude/skills/qcsd-refinement-swarm/steps/08-transformation.md +36 -0
- package/.claude/skills/qcsd-refinement-swarm/steps/09-final-output.md +46 -0
- package/.claude/skills/sherlock-review/SKILL.md +3 -0
- package/.claude/skills/skill-builder/SKILL.md +103 -0
- package/.claude/skills/skills-manifest.json +1 -1
- package/CHANGELOG.md +22 -0
- package/assets/agents/v3/qe-devils-advocate.md +20 -0
- package/assets/agents/v3/qe-gap-detector.md +25 -0
- package/assets/agents/v3/qe-quality-gate.md +8 -0
- package/assets/agents/v3/qe-requirements-validator.md +25 -0
- package/assets/agents/v3/subagents/qe-code-reviewer.md +11 -0
- package/assets/agents/v3/subagents/qe-integration-reviewer.md +11 -0
- package/assets/agents/v3/subagents/qe-performance-reviewer.md +11 -0
- package/assets/agents/v3/subagents/qe-security-reviewer.md +11 -0
- package/assets/helpers/statusline-v3.cjs +693 -0
- package/assets/skills/brutal-honesty-review/SKILL.md +3 -0
- package/assets/skills/code-review-quality/SKILL.md +3 -0
- package/assets/skills/qcsd-cicd-swarm/SKILL.md +79 -2075
- package/assets/skills/qcsd-cicd-swarm/steps/01-flag-detection.md +62 -0
- package/assets/skills/qcsd-cicd-swarm/steps/02-core-agents.md +33 -0
- package/assets/skills/qcsd-cicd-swarm/steps/03-batch1-results.md +21 -0
- package/assets/skills/qcsd-cicd-swarm/steps/04-conditional-agents.md +23 -0
- package/assets/skills/qcsd-cicd-swarm/steps/05-decision-synthesis.md +30 -0
- package/assets/skills/qcsd-cicd-swarm/steps/06-report-generation.md +17 -0
- package/assets/skills/qcsd-cicd-swarm/steps/07-learning-persistence.md +27 -0
- package/assets/skills/qcsd-cicd-swarm/steps/08-deployment-advisor.md +25 -0
- package/assets/skills/qcsd-cicd-swarm/steps/09-final-output.md +16 -0
- package/assets/skills/qcsd-development-swarm/SKILL.md +79 -2027
- package/assets/skills/qcsd-development-swarm/steps/01-flag-detection.md +50 -0
- package/assets/skills/qcsd-development-swarm/steps/02-core-agents.md +29 -0
- package/assets/skills/qcsd-development-swarm/steps/03-batch1-results.md +14 -0
- package/assets/skills/qcsd-development-swarm/steps/04-conditional-agents.md +23 -0
- package/assets/skills/qcsd-development-swarm/steps/05-decision-synthesis.md +30 -0
- package/assets/skills/qcsd-development-swarm/steps/06-report-generation.md +16 -0
- package/assets/skills/qcsd-development-swarm/steps/07-learning-persistence.md +25 -0
- package/assets/skills/qcsd-development-swarm/steps/08-defect-predictor.md +25 -0
- package/assets/skills/qcsd-development-swarm/steps/09-final-output.md +16 -0
- package/assets/skills/qcsd-ideation-swarm/SKILL.md +94 -1894
- package/assets/skills/qcsd-ideation-swarm/steps/01-flag-detection.md +57 -0
- package/assets/skills/qcsd-ideation-swarm/steps/02-core-agents.md +29 -0
- package/assets/skills/qcsd-ideation-swarm/steps/03-batch1-results.md +15 -0
- package/assets/skills/qcsd-ideation-swarm/steps/04-conditional-agents.md +23 -0
- package/assets/skills/qcsd-ideation-swarm/steps/05-decision-synthesis.md +29 -0
- package/assets/skills/qcsd-ideation-swarm/steps/06-report-generation.md +18 -0
- package/assets/skills/qcsd-ideation-swarm/steps/07-learning-persistence.md +29 -0
- package/assets/skills/qcsd-ideation-swarm/steps/08-final-output.md +18 -0
- package/assets/skills/qcsd-production-swarm/SKILL.md +88 -2663
- package/assets/skills/qcsd-production-swarm/steps/01-flag-detection.md +206 -0
- package/assets/skills/qcsd-production-swarm/steps/02-core-agents.md +428 -0
- package/assets/skills/qcsd-production-swarm/steps/03-batch1-results.md +101 -0
- package/assets/skills/qcsd-production-swarm/steps/04-conditional-agents.md +125 -0
- package/assets/skills/qcsd-production-swarm/steps/05-decision-synthesis.md +136 -0
- package/assets/skills/qcsd-production-swarm/steps/06-report-generation.md +181 -0
- package/assets/skills/qcsd-production-swarm/steps/07-learning-persistence.md +185 -0
- package/assets/skills/qcsd-production-swarm/steps/08-feedback-loop.md +122 -0
- package/assets/skills/qcsd-production-swarm/steps/09-final-output.md +140 -0
- package/assets/skills/qcsd-refinement-swarm/SKILL.md +59 -2312
- package/assets/skills/qcsd-refinement-swarm/steps/01-flag-detection.md +91 -0
- package/assets/skills/qcsd-refinement-swarm/steps/02-core-agents.md +40 -0
- package/assets/skills/qcsd-refinement-swarm/steps/03-batch1-results.md +40 -0
- package/assets/skills/qcsd-refinement-swarm/steps/04-conditional-agents.md +35 -0
- package/assets/skills/qcsd-refinement-swarm/steps/05-decision-synthesis.md +43 -0
- package/assets/skills/qcsd-refinement-swarm/steps/06-report-generation.md +42 -0
- package/assets/skills/qcsd-refinement-swarm/steps/07-learning-persistence.md +53 -0
- package/assets/skills/qcsd-refinement-swarm/steps/08-transformation.md +36 -0
- package/assets/skills/qcsd-refinement-swarm/steps/09-final-output.md +46 -0
- package/assets/skills/sherlock-review/SKILL.md +3 -0
- package/assets/templates/agent-override-example.yaml +39 -0
- package/dist/agents/devils-advocate/agent.d.ts +25 -1
- package/dist/agents/devils-advocate/agent.js +108 -4
- package/dist/agents/devils-advocate/types.d.ts +54 -0
- package/dist/agents/devils-advocate/types.js +14 -0
- package/dist/agents/overlay-loader.d.ts +28 -0
- package/dist/agents/overlay-loader.js +232 -0
- package/dist/agents/overlay-schema.d.ts +56 -0
- package/dist/agents/overlay-schema.js +77 -0
- package/dist/analysis/branch-enumerator.d.ts +68 -0
- package/dist/analysis/branch-enumerator.js +393 -0
- package/dist/analysis/index.d.ts +2 -0
- package/dist/analysis/index.js +2 -0
- package/dist/cli/bundle.js +2396 -614
- package/dist/cli/commands/coverage.js +50 -0
- package/dist/context/compiler.d.ts +62 -0
- package/dist/context/compiler.js +143 -0
- package/dist/context/index.d.ts +8 -0
- package/dist/context/index.js +6 -0
- package/dist/context/sources/coverage-source.d.ts +15 -0
- package/dist/context/sources/coverage-source.js +77 -0
- package/dist/context/sources/git-source.d.ts +12 -0
- package/dist/context/sources/git-source.js +33 -0
- package/dist/context/sources/index.d.ts +6 -0
- package/dist/context/sources/index.js +5 -0
- package/dist/context/sources/memory-source.d.ts +17 -0
- package/dist/context/sources/memory-source.js +94 -0
- package/dist/context/sources/test-source.d.ts +13 -0
- package/dist/context/sources/test-source.js +53 -0
- package/dist/context/sources/types.d.ts +42 -0
- package/dist/context/sources/types.js +5 -0
- package/dist/init/agents-installer.d.ts +9 -0
- package/dist/init/agents-installer.js +72 -0
- package/dist/init/phases/07-hooks.d.ts +11 -0
- package/dist/init/phases/07-hooks.js +67 -0
- package/dist/init/phases/09-assets.js +3 -0
- package/dist/init/settings-merge.js +1 -1
- package/dist/mcp/bundle.js +4411 -3979
- package/dist/mcp/services/task-router.d.ts +11 -0
- package/dist/mcp/services/task-router.js +26 -0
- package/dist/routing/qe-agent-registry.d.ts +11 -0
- package/dist/routing/qe-agent-registry.js +34 -0
- package/dist/routing/qe-task-router.d.ts +1 -0
- package/dist/routing/qe-task-router.js +34 -2
- package/dist/routing/types.d.ts +2 -0
- package/dist/validation/index.d.ts +3 -0
- package/dist/validation/index.js +10 -0
- package/dist/validation/pipeline.d.ts +80 -0
- package/dist/validation/pipeline.js +173 -0
- package/dist/validation/steps/requirements.d.ts +32 -0
- package/dist/validation/steps/requirements.js +596 -0
- package/package.json +6 -6
- package/.claude/agents/consensus/README.md +0 -253
- package/.claude/agents/deprecated/qe-api-contract-validator.md.v2 +0 -162
- package/.claude/agents/deprecated/qe-coverage-analyzer.md.v2 +0 -208
- package/.claude/agents/deprecated/qe-test-generator.md.v2 +0 -212
- package/.claude/agents/deprecated/qe-visual-tester.md.v2 +0 -216
- package/.claude/agents/hive-mind/collective-intelligence-coordinator.md +0 -130
- package/.claude/agents/hive-mind/queen-coordinator.md +0 -203
- package/.claude/agents/hive-mind/scout-explorer.md +0 -242
- package/.claude/agents/hive-mind/swarm-memory-manager.md +0 -193
- package/.claude/agents/hive-mind/worker-specialist.md +0 -217
- package/.claude/agents/neural/safla-neural.md +0 -74
- package/.claude/agents/optimization/README.md +0 -250
- package/.claude/agents/reasoning/agent.md +0 -816
- package/.claude/agents/reasoning/goal-planner.md +0 -73
- package/.claude/agents/subagents/qe-code-reviewer.md +0 -76
- package/.claude/agents/subagents/qe-coverage-gap-analyzer.md +0 -76
- package/.claude/agents/subagents/qe-data-generator.md +0 -77
- package/.claude/agents/subagents/qe-flaky-investigator.md +0 -91
- package/.claude/agents/subagents/qe-integration-tester.md +0 -90
- package/.claude/agents/subagents/qe-performance-validator.md +0 -92
- package/.claude/agents/subagents/qe-security-auditor.md +0 -94
- package/.claude/agents/subagents/qe-test-data-architect-sub.md +0 -93
- package/.claude/agents/subagents/qe-test-implementer.md +0 -106
- package/.claude/agents/subagents/qe-test-refactorer.md +0 -117
- package/.claude/agents/subagents/qe-test-writer.md +0 -112
- package/.claude/agents/swarm/README.md +0 -190
- package/.claude/agents/templates/migration-plan.md +0 -746
- package/.claude/agents/testing/unit/tdd-london-swarm.md +0 -244
- package/.claude/agents/testing/validation/production-validator.md +0 -395
- package/.claude/agents/v3/README.md +0 -39
- package/.claude/agents/v3/typescript-specialist.yaml +0 -21
- package/.claude/agents/v3/v3-memory-specialist.md +0 -318
- package/.claude/agents/v3/v3-performance-engineer.md +0 -397
- package/.claude/agents/v3/v3-queen-coordinator.md +0 -98
- package/.claude/agents/v3/v3-security-architect.md +0 -174
- package/.claude/commands/README.md +0 -106
- package/.claude/commands/agents/README.md +0 -10
- package/.claude/commands/agents/agent-capabilities.md +0 -21
- package/.claude/commands/agents/agent-coordination.md +0 -28
- package/.claude/commands/agents/agent-spawning.md +0 -28
- package/.claude/commands/agents/agent-types.md +0 -26
- package/.claude/commands/coordination/README.md +0 -9
- package/.claude/commands/coordination/agent-spawn.md +0 -25
- package/.claude/commands/coordination/init.md +0 -44
- package/.claude/commands/coordination/orchestrate.md +0 -43
- package/.claude/commands/coordination/spawn.md +0 -45
- package/.claude/commands/coordination/swarm-init.md +0 -85
- package/.claude/commands/coordination/task-orchestrate.md +0 -25
- package/.claude/commands/hive-mind/README.md +0 -17
- package/.claude/commands/hive-mind/hive-mind-consensus.md +0 -8
- package/.claude/commands/hive-mind/hive-mind-init.md +0 -18
- package/.claude/commands/hive-mind/hive-mind-memory.md +0 -8
- package/.claude/commands/hive-mind/hive-mind-metrics.md +0 -8
- package/.claude/commands/hive-mind/hive-mind-resume.md +0 -8
- package/.claude/commands/hive-mind/hive-mind-sessions.md +0 -8
- package/.claude/commands/hive-mind/hive-mind-spawn.md +0 -21
- package/.claude/commands/hive-mind/hive-mind-status.md +0 -8
- package/.claude/commands/hive-mind/hive-mind-stop.md +0 -8
- package/.claude/commands/hive-mind/hive-mind-wizard.md +0 -8
- package/.claude/commands/hive-mind/hive-mind.md +0 -27
- package/.claude/commands/memory/README.md +0 -9
- package/.claude/commands/memory/memory-persist.md +0 -25
- package/.claude/commands/memory/memory-search.md +0 -25
- package/.claude/commands/memory/memory-usage.md +0 -25
- package/.claude/commands/memory/neural.md +0 -47
- package/.claude/commands/swarm/README.md +0 -15
- package/.claude/commands/swarm/swarm-analysis.md +0 -8
- package/.claude/commands/swarm/swarm-background.md +0 -8
- package/.claude/commands/swarm/swarm-init.md +0 -19
- package/.claude/commands/swarm/swarm-modes.md +0 -8
- package/.claude/commands/swarm/swarm-monitor.md +0 -8
- package/.claude/commands/swarm/swarm-spawn.md +0 -19
- package/.claude/commands/swarm/swarm-status.md +0 -8
- package/.claude/commands/swarm/swarm-strategies.md +0 -8
- package/.claude/commands/swarm/swarm.md +0 -27
- package/.claude/commands/training/README.md +0 -9
- package/.claude/commands/training/model-update.md +0 -25
- package/.claude/commands/training/neural-patterns.md +0 -74
- package/.claude/commands/training/neural-train.md +0 -25
- package/.claude/commands/training/pattern-learn.md +0 -25
- package/.claude/commands/training/specialization.md +0 -63
- package/.claude/commands/workflows/README.md +0 -9
- package/.claude/commands/workflows/development.md +0 -78
- package/.claude/commands/workflows/research.md +0 -63
- package/.claude/commands/workflows/workflow-create.md +0 -25
- package/.claude/commands/workflows/workflow-execute.md +0 -25
- package/.claude/commands/workflows/workflow-export.md +0 -25
- package/.claude/skills/agentic-jujutsu/SKILL.md +0 -645
- package/.claude/skills/hive-mind-advanced/SKILL.md +0 -712
- package/.claude/skills/iterative-loop/SKILL.md +0 -371
- package/.claude/skills/performance-analysis/SKILL.md +0 -569
- package/.claude/skills/performance-analysis/evals/performance-analysis.yaml +0 -144
- package/.claude/skills/performance-analysis/schemas/output.json +0 -588
- package/.claude/skills/performance-analysis/scripts/validate-config.json +0 -36
|
@@ -0,0 +1,206 @@
|
|
|
1
|
+
# Step 1: Flag & Signal Detection
|
|
2
|
+
|
|
3
|
+
## Prerequisites
|
|
4
|
+
- Production swarm skill invoked
|
|
5
|
+
- TELEMETRY_DATA path provided (or pre-collected telemetry available)
|
|
6
|
+
- RELEASE_ID identified (optional)
|
|
7
|
+
- OUTPUT_FOLDER determined
|
|
8
|
+
|
|
9
|
+
## Instructions
|
|
10
|
+
|
|
11
|
+
### Step 0: Retrieve CI/CD Phase Signals (Cross-Phase Consumption)
|
|
12
|
+
|
|
13
|
+
Before analyzing production context, retrieve the most recent CI/CD phase signals from memory.
|
|
14
|
+
These provide the release readiness baseline that the Production Swarm builds upon.
|
|
15
|
+
|
|
16
|
+
**MCP Method (preferred):**
|
|
17
|
+
|
|
18
|
+
```javascript
|
|
19
|
+
mcp__agentic-qe__memory_query({
|
|
20
|
+
pattern: "qcsd-cicd-*",
|
|
21
|
+
namespace: "qcsd-cicd",
|
|
22
|
+
limit: 1
|
|
23
|
+
})
|
|
24
|
+
```
|
|
25
|
+
|
|
26
|
+
**CLI Fallback:**
|
|
27
|
+
|
|
28
|
+
```bash
|
|
29
|
+
npx @claude-flow/cli@latest memory search --query "qcsd-cicd" --namespace qcsd-cicd --limit 1
|
|
30
|
+
```
|
|
31
|
+
|
|
32
|
+
**Extract and record CI/CD baseline (if available):**
|
|
33
|
+
|
|
34
|
+
```
|
|
35
|
+
+-------------------------------------------------------------+
|
|
36
|
+
| CI/CD PHASE BASELINE |
|
|
37
|
+
+-------------------------------------------------------------+
|
|
38
|
+
| |
|
|
39
|
+
| Retrieved: [YES / NO - memory query failed] |
|
|
40
|
+
| |
|
|
41
|
+
| Release Decision: [RELEASE / REMEDIATE / BLOCK / N/A] |
|
|
42
|
+
| Deployment Risk Score: [value / N/A] |
|
|
43
|
+
| Quality Gate Status: [PASSED / FAILED / N/A] |
|
|
44
|
+
| Known Issues: [list / NONE] |
|
|
45
|
+
| Monitoring Recommendations: [list / NONE] |
|
|
46
|
+
| |
|
|
47
|
+
| If NO CI/CD baseline: Proceed without baseline. |
|
|
48
|
+
| Note "NO CI/CD BASELINE AVAILABLE" in report. |
|
|
49
|
+
| |
|
|
50
|
+
+-------------------------------------------------------------+
|
|
51
|
+
```
|
|
52
|
+
|
|
53
|
+
**DO NOT skip this step.** If memory retrieval fails, proceed without baseline but document the gap.
|
|
54
|
+
|
|
55
|
+
---
|
|
56
|
+
|
|
57
|
+
### Step 0.5: Auto-Detect Pre-Collected Telemetry
|
|
58
|
+
|
|
59
|
+
Before requiring manual telemetry input, check if the GitHub Actions telemetry collection
|
|
60
|
+
workflow has pre-collected DORA metrics. This runs automatically after every npm publish
|
|
61
|
+
and weekly on schedule.
|
|
62
|
+
|
|
63
|
+
**Check for pre-collected telemetry:**
|
|
64
|
+
|
|
65
|
+
```bash
|
|
66
|
+
TELEMETRY_FILE="docs/telemetry/production/latest.json"
|
|
67
|
+
```
|
|
68
|
+
|
|
69
|
+
**If the file exists and is recent (< 7 days old):**
|
|
70
|
+
- Use it as the primary TELEMETRY_DATA source
|
|
71
|
+
- The DORA metrics (deployment frequency, lead time, change failure rate, MTTR) are already
|
|
72
|
+
computed from GitHub API — the qe-metrics-optimizer agent should validate and enrich these,
|
|
73
|
+
not recompute from scratch
|
|
74
|
+
- Record: `TELEMETRY SOURCE: GHA pre-collected (${collectionTimestamp from JSON})`
|
|
75
|
+
- Extract the `releaseId` from the JSON if RELEASE_ID was not provided as a parameter
|
|
76
|
+
|
|
77
|
+
**If the file does not exist or is stale (> 7 days old):**
|
|
78
|
+
- Proceed with the manually provided TELEMETRY_DATA parameter as currently specified
|
|
79
|
+
- Record: `TELEMETRY SOURCE: Manual input`
|
|
80
|
+
|
|
81
|
+
**This step is non-blocking.** If pre-collected telemetry is unavailable, the swarm
|
|
82
|
+
operates exactly as before. Pre-collected telemetry simply accelerates Phase 2 by
|
|
83
|
+
giving qe-metrics-optimizer a validated starting point.
|
|
84
|
+
|
|
85
|
+
---
|
|
86
|
+
|
|
87
|
+
### Step 1: Scan Production Context and Detect Flags
|
|
88
|
+
|
|
89
|
+
Scan the production telemetry, incident reports, DORA data, and release context to SET these flags. Do not skip any flag.
|
|
90
|
+
|
|
91
|
+
### Flag Detection (Check ALL SEVEN)
|
|
92
|
+
|
|
93
|
+
```
|
|
94
|
+
HAS_INFRASTRUCTURE_CHANGE = FALSE
|
|
95
|
+
Set TRUE if input mentions RECENT infrastructure changes since last release:
|
|
96
|
+
Kubernetes config changes, container image updates, cloud resource modifications,
|
|
97
|
+
deployment topology changes, scaling policy updates, network rule changes,
|
|
98
|
+
load balancer updates, DNS changes, certificate rotations, CDN changes.
|
|
99
|
+
NOTE: General mentions of infrastructure existing do NOT trigger this flag.
|
|
100
|
+
Only RECENT CHANGES to infrastructure trigger it.
|
|
101
|
+
|
|
102
|
+
HAS_PERFORMANCE_SLA = FALSE
|
|
103
|
+
Set TRUE if input mentions ANY of: SLA, SLO, SLI, response time requirements,
|
|
104
|
+
latency targets, error budgets, throughput thresholds, availability targets,
|
|
105
|
+
uptime requirements, p95 latency, p99 latency, error rate targets
|
|
106
|
+
|
|
107
|
+
HAS_REGRESSION_RISK = FALSE
|
|
108
|
+
Set TRUE if input mentions ANY of: user-reported issues, error rate increases,
|
|
109
|
+
degraded functionality, rollback consideration, feature flag incidents,
|
|
110
|
+
A/B test anomalies, customer complaints, support ticket spikes,
|
|
111
|
+
monitoring alerts, degraded performance post-deploy
|
|
112
|
+
|
|
113
|
+
HAS_RECURRING_INCIDENTS = FALSE
|
|
114
|
+
Set TRUE if input mentions ANY of: repeated incidents, known recurring issues,
|
|
115
|
+
incident patterns, chronic alerts, previously-seen failure modes,
|
|
116
|
+
flapping services, repeat offender modules, recurring pages,
|
|
117
|
+
same-root-cause incidents, deja-vu failures
|
|
118
|
+
|
|
119
|
+
HAS_MIDDLEWARE = FALSE
|
|
120
|
+
Set TRUE if input mentions ANY of: middleware, ESB, message broker, MQ,
|
|
121
|
+
Kafka, RabbitMQ, integration bus, API gateway, message queue, pub/sub,
|
|
122
|
+
event bus, service bus, ActiveMQ, NATS, Redis Streams
|
|
123
|
+
|
|
124
|
+
HAS_SAP_INTEGRATION = FALSE
|
|
125
|
+
Set TRUE if input mentions ANY of: SAP, RFC, BAPI, IDoc, OData,
|
|
126
|
+
S/4HANA, EWM, ECC, ABAP, CDS view, Fiori, SAP Cloud Integration,
|
|
127
|
+
SAP PI/PO, SAP Gateway, SAP connector
|
|
128
|
+
|
|
129
|
+
HAS_AUTHORIZATION = FALSE
|
|
130
|
+
Set TRUE if input mentions ANY of: SoD, segregation of duties,
|
|
131
|
+
role conflict, authorization object, T-code, user role,
|
|
132
|
+
access control matrix, GRC, RBAC policy, permission matrix,
|
|
133
|
+
privilege escalation, role assignment
|
|
134
|
+
```
|
|
135
|
+
|
|
136
|
+
### Validation Checkpoint
|
|
137
|
+
|
|
138
|
+
Before proceeding, confirm:
|
|
139
|
+
|
|
140
|
+
```
|
|
141
|
+
+-- I have read the production telemetry and incident reports
|
|
142
|
+
+-- I have read the DORA metrics data
|
|
143
|
+
+-- I have reviewed the release context and CI/CD phase signals
|
|
144
|
+
+-- I have evaluated ALL SEVEN flags
|
|
145
|
+
+-- I have recorded which flags are TRUE
|
|
146
|
+
+-- I understand which conditional agents will be needed
|
|
147
|
+
```
|
|
148
|
+
|
|
149
|
+
**DO NOT proceed until all checkboxes are confirmed.**
|
|
150
|
+
|
|
151
|
+
### MANDATORY: Output Flag Detection Results
|
|
152
|
+
|
|
153
|
+
You MUST output flag detection results before proceeding:
|
|
154
|
+
|
|
155
|
+
```
|
|
156
|
+
+-------------------------------------------------------------+
|
|
157
|
+
| FLAG DETECTION RESULTS |
|
|
158
|
+
+-------------------------------------------------------------+
|
|
159
|
+
| |
|
|
160
|
+
| HAS_INFRASTRUCTURE_CHANGE: [TRUE/FALSE] |
|
|
161
|
+
| Evidence: [what triggered it - specific] |
|
|
162
|
+
| |
|
|
163
|
+
| HAS_PERFORMANCE_SLA: [TRUE/FALSE] |
|
|
164
|
+
| Evidence: [what triggered it - specific] |
|
|
165
|
+
| |
|
|
166
|
+
| HAS_REGRESSION_RISK: [TRUE/FALSE] |
|
|
167
|
+
| Evidence: [what triggered it - specific] |
|
|
168
|
+
| |
|
|
169
|
+
| HAS_RECURRING_INCIDENTS: [TRUE/FALSE] |
|
|
170
|
+
| Evidence: [what triggered it - specific] |
|
|
171
|
+
| |
|
|
172
|
+
| HAS_MIDDLEWARE: [TRUE/FALSE] |
|
|
173
|
+
| Evidence: [what triggered it - specific] |
|
|
174
|
+
| |
|
|
175
|
+
| HAS_SAP_INTEGRATION: [TRUE/FALSE] |
|
|
176
|
+
| Evidence: [what triggered it - specific] |
|
|
177
|
+
| |
|
|
178
|
+
| HAS_AUTHORIZATION: [TRUE/FALSE] |
|
|
179
|
+
| Evidence: [what triggered it - specific] |
|
|
180
|
+
| |
|
|
181
|
+
| EXPECTED AGENTS: |
|
|
182
|
+
| - Core: 3 (always) |
|
|
183
|
+
| - Conditional: [count based on TRUE flags] |
|
|
184
|
+
| - Feedback: 2 (always) |
|
|
185
|
+
| - TOTAL: [3 + conditional count + 2] |
|
|
186
|
+
| |
|
|
187
|
+
+-------------------------------------------------------------+
|
|
188
|
+
```
|
|
189
|
+
|
|
190
|
+
## Success Criteria
|
|
191
|
+
- [ ] CI/CD phase signals retrieved (or documented as unavailable)
|
|
192
|
+
- [ ] Pre-collected telemetry checked
|
|
193
|
+
- [ ] All SEVEN flags evaluated with evidence
|
|
194
|
+
- [ ] Flag detection results output in the required format
|
|
195
|
+
- [ ] Expected agent count calculated
|
|
196
|
+
|
|
197
|
+
## Output
|
|
198
|
+
Provide to the next step:
|
|
199
|
+
- CI/CD baseline data (or "NO CI/CD BASELINE AVAILABLE")
|
|
200
|
+
- Telemetry source (GHA pre-collected or Manual input)
|
|
201
|
+
- All seven flag values with evidence
|
|
202
|
+
- Expected agent count (core + conditional + feedback)
|
|
203
|
+
|
|
204
|
+
## Navigation
|
|
205
|
+
- On success: proceed to Step 2 (Core Agents) by reading `steps/02-core-agents.md`
|
|
206
|
+
- On failure: halt and report which flags could not be evaluated or which data was missing
|
|
@@ -0,0 +1,428 @@
|
|
|
1
|
+
# Step 2: Spawn Core Agents (Parallel Batch 1)
|
|
2
|
+
|
|
3
|
+
## Prerequisites
|
|
4
|
+
- Step 1 (Flag Detection) completed successfully
|
|
5
|
+
- All seven flags evaluated and recorded
|
|
6
|
+
- Production telemetry data available
|
|
7
|
+
- OUTPUT_FOLDER determined
|
|
8
|
+
|
|
9
|
+
## Instructions
|
|
10
|
+
|
|
11
|
+
### CRITICAL ENFORCEMENT
|
|
12
|
+
|
|
13
|
+
```
|
|
14
|
+
+-------------------------------------------------------------+
|
|
15
|
+
| YOU MUST INCLUDE ALL THREE TASK CALLS IN YOUR NEXT MESSAGE |
|
|
16
|
+
| |
|
|
17
|
+
| - Task 1: qe-metrics-optimizer |
|
|
18
|
+
| - Task 2: qe-defect-predictor |
|
|
19
|
+
| - Task 3: qe-root-cause-analyzer |
|
|
20
|
+
| |
|
|
21
|
+
| If your message contains fewer than 3 Task calls, you have |
|
|
22
|
+
| FAILED this phase. Start over. |
|
|
23
|
+
+-------------------------------------------------------------+
|
|
24
|
+
```
|
|
25
|
+
|
|
26
|
+
### Domain Context
|
|
27
|
+
|
|
28
|
+
| Agent | Domain | MCP Tool Mapping |
|
|
29
|
+
|-------|--------|------------------|
|
|
30
|
+
| qe-metrics-optimizer | learning-optimization | `quality_assess` |
|
|
31
|
+
| qe-defect-predictor | defect-intelligence | `defect_predict` |
|
|
32
|
+
| qe-root-cause-analyzer | defect-intelligence | `root_cause_analyze` |
|
|
33
|
+
|
|
34
|
+
### Agent 1: DORA Metrics Optimizer
|
|
35
|
+
|
|
36
|
+
**This agent MUST compute DORA metrics and SLA/SLO compliance from production telemetry.**
|
|
37
|
+
|
|
38
|
+
```
|
|
39
|
+
Task({
|
|
40
|
+
description: "DORA metrics computation and SLA compliance assessment",
|
|
41
|
+
prompt: `You are qe-metrics-optimizer. Your output quality is being audited.
|
|
42
|
+
|
|
43
|
+
## MANDATORY FIRST STEPS (DO NOT SKIP)
|
|
44
|
+
|
|
45
|
+
1. READ the production telemetry data provided below IN FULL.
|
|
46
|
+
2. READ the SLA/SLO definitions if available.
|
|
47
|
+
3. READ any previous CI/CD phase signals if available.
|
|
48
|
+
|
|
49
|
+
## PRODUCTION DATA TO ANALYZE
|
|
50
|
+
|
|
51
|
+
=== DORA METRICS DATA START ===
|
|
52
|
+
[PASTE THE COMPLETE DORA METRICS DATA HERE - DO NOT SUMMARIZE]
|
|
53
|
+
- Deployment frequency records
|
|
54
|
+
- Lead time for changes data
|
|
55
|
+
- Mean time to restore (MTTR) records
|
|
56
|
+
- Change failure rate data
|
|
57
|
+
=== DORA METRICS DATA END ===
|
|
58
|
+
|
|
59
|
+
=== SLA/SLO DEFINITIONS START ===
|
|
60
|
+
[PASTE SLA/SLO TARGET DEFINITIONS HERE - DO NOT SUMMARIZE]
|
|
61
|
+
=== SLA/SLO DEFINITIONS END ===
|
|
62
|
+
|
|
63
|
+
=== PRODUCTION TELEMETRY START ===
|
|
64
|
+
[PASTE PRODUCTION TELEMETRY DATA HERE - DO NOT SUMMARIZE]
|
|
65
|
+
- Uptime metrics
|
|
66
|
+
- Error rates
|
|
67
|
+
- Response time distributions
|
|
68
|
+
- Throughput data
|
|
69
|
+
=== PRODUCTION TELEMETRY END ===
|
|
70
|
+
|
|
71
|
+
=== CI/CD PHASE SIGNALS (if available) START ===
|
|
72
|
+
[PASTE any CI/CD phase RELEASE/REMEDIATE/BLOCK signals]
|
|
73
|
+
=== CI/CD PHASE SIGNALS END ===
|
|
74
|
+
|
|
75
|
+
## REQUIRED OUTPUT (ALL SECTIONS MANDATORY)
|
|
76
|
+
|
|
77
|
+
### 1. DORA Dashboard
|
|
78
|
+
|
|
79
|
+
Compute all four DORA metrics with trends:
|
|
80
|
+
|
|
81
|
+
| DORA Metric | Current Value | Previous Period | Trend | Classification |
|
|
82
|
+
|-------------|---------------|-----------------|-------|----------------|
|
|
83
|
+
| Deployment Frequency | X/day or X/week | X/day or X/week | Improving/Declining/Stable | Elite/High/Medium/Low |
|
|
84
|
+
| Lead Time for Changes | X hours/days | X hours/days | Improving/Declining/Stable | Elite/High/Medium/Low |
|
|
85
|
+
| Mean Time to Restore (MTTR) | X hours | X hours | Improving/Declining/Stable | Elite/High/Medium/Low |
|
|
86
|
+
| Change Failure Rate | X% | X% | Improving/Declining/Stable | Elite/High/Medium/Low |
|
|
87
|
+
|
|
88
|
+
**DORA Classification Thresholds:**
|
|
89
|
+
| Metric | Elite | High | Medium | Low |
|
|
90
|
+
|--------|-------|------|--------|-----|
|
|
91
|
+
| Deployment Frequency | On-demand (multiple/day) | Weekly-Monthly | Monthly-Biannual | Biannual+ |
|
|
92
|
+
| Lead Time | < 1 hour | 1 day - 1 week | 1 week - 1 month | 1-6 months |
|
|
93
|
+
| MTTR | < 1 hour | < 1 day | < 1 week | 1 week+ |
|
|
94
|
+
| Change Failure Rate | 0-5% | 5-10% | 10-15% | 15%+ |
|
|
95
|
+
|
|
96
|
+
**OVERALL DORA CLASSIFICATION: [Elite/High/Medium/Low]**
|
|
97
|
+
|
|
98
|
+
### 2. SLA Compliance Matrix
|
|
99
|
+
|
|
100
|
+
| SLA/SLO | Target | Actual | Compliance | Status | Burn Rate |
|
|
101
|
+
|---------|--------|--------|------------|--------|-----------|
|
|
102
|
+
| Availability | X% | X% | X% | PASS/WARN/FAIL | [error budget remaining] |
|
|
103
|
+
| Response Time (p50) | Xms | Xms | X% | PASS/WARN/FAIL | N/A |
|
|
104
|
+
| Response Time (p95) | Xms | Xms | X% | PASS/WARN/FAIL | N/A |
|
|
105
|
+
| Response Time (p99) | Xms | Xms | X% | PASS/WARN/FAIL | N/A |
|
|
106
|
+
| Error Rate | <= X% | X% | X% | PASS/WARN/FAIL | [error budget remaining] |
|
|
107
|
+
| Throughput | >= X req/s | X req/s | X% | PASS/WARN/FAIL | N/A |
|
|
108
|
+
|
|
109
|
+
**SLA COMPLIANCE: X% (count of passing SLAs / total SLAs)**
|
|
110
|
+
|
|
111
|
+
### 3. Quality Metrics Optimization
|
|
112
|
+
|
|
113
|
+
| Quality Metric | Current | Target | Gap | Trend | Action |
|
|
114
|
+
|---------------|---------|--------|-----|-------|--------|
|
|
115
|
+
| Defect Escape Rate | X% | <= X% | +/-X% | Improving/Declining | [action] |
|
|
116
|
+
| Test Effectiveness | X% | >= X% | +/-X% | Improving/Declining | [action] |
|
|
117
|
+
| Automation Coverage | X% | >= X% | +/-X% | Improving/Declining | [action] |
|
|
118
|
+
| Mean Time to Detect | X hours | <= X hours | +/-X hours | Improving/Declining | [action] |
|
|
119
|
+
| Customer-Reported vs Internal | X:Y ratio | <= X:Y | +/-X | Improving/Declining | [action] |
|
|
120
|
+
|
|
121
|
+
### 4. Composite DORA Score
|
|
122
|
+
|
|
123
|
+
Calculate normalized score (0-1):
|
|
124
|
+
|
|
125
|
+
| Metric | Raw Score | Weight | Weighted Score |
|
|
126
|
+
|--------|-----------|--------|----------------|
|
|
127
|
+
| Deployment Frequency | X/1.0 | 0.25 | X |
|
|
128
|
+
| Lead Time | X/1.0 | 0.25 | X |
|
|
129
|
+
| MTTR | X/1.0 | 0.25 | X |
|
|
130
|
+
| Change Failure Rate | X/1.0 | 0.25 | X |
|
|
131
|
+
|
|
132
|
+
**COMPOSITE DORA SCORE: X.XX (0-1 scale)**
|
|
133
|
+
|
|
134
|
+
Scoring guide:
|
|
135
|
+
- Elite: 0.85 - 1.0
|
|
136
|
+
- High: 0.7 - 0.84
|
|
137
|
+
- Medium: 0.4 - 0.69
|
|
138
|
+
- Low: 0.0 - 0.39
|
|
139
|
+
|
|
140
|
+
**MINIMUM: Compute all 4 DORA metrics with classifications and produce SLA compliance matrix.**
|
|
141
|
+
|
|
142
|
+
## OUTPUT FORMAT
|
|
143
|
+
|
|
144
|
+
Save your complete analysis in Markdown to:
|
|
145
|
+
${OUTPUT_FOLDER}/02-dora-metrics.md
|
|
146
|
+
|
|
147
|
+
Use the Write tool to save BEFORE completing.
|
|
148
|
+
Report MUST be complete - no placeholders.
|
|
149
|
+
|
|
150
|
+
## VALIDATION BEFORE SUBMITTING
|
|
151
|
+
|
|
152
|
+
+-- Did I read all production telemetry and DORA data?
|
|
153
|
+
+-- Did I compute all 4 DORA metrics with trends?
|
|
154
|
+
+-- Did I classify each metric (Elite/High/Medium/Low)?
|
|
155
|
+
+-- Did I evaluate SLA/SLO compliance for all targets?
|
|
156
|
+
+-- Did I calculate the composite DORA score (0-1)?
|
|
157
|
+
+-- Did I assess quality metrics optimization opportunities?
|
|
158
|
+
+-- Did I save the report to the correct output path?`,
|
|
159
|
+
subagent_type: "qe-metrics-optimizer",
|
|
160
|
+
run_in_background: true
|
|
161
|
+
})
|
|
162
|
+
```
|
|
163
|
+
|
|
164
|
+
### Agent 2: Defect Predictor
|
|
165
|
+
|
|
166
|
+
**This agent MUST analyze defect trends and predict future defect density from production telemetry patterns.**
|
|
167
|
+
|
|
168
|
+
```
|
|
169
|
+
Task({
|
|
170
|
+
description: "ML-powered defect prediction and trend analysis from production data",
|
|
171
|
+
prompt: `You are qe-defect-predictor. Your output quality is being audited.
|
|
172
|
+
|
|
173
|
+
## PRODUCTION DATA TO ANALYZE
|
|
174
|
+
|
|
175
|
+
=== DEFECT DATA START ===
|
|
176
|
+
[PASTE THE COMPLETE DEFECT/BUG REPORT DATA HERE - DO NOT SUMMARIZE]
|
|
177
|
+
- All defects discovered post-release
|
|
178
|
+
- Severity classifications
|
|
179
|
+
- Component/module mapping
|
|
180
|
+
- Discovery date and resolution status
|
|
181
|
+
=== DEFECT DATA END ===
|
|
182
|
+
|
|
183
|
+
=== PRODUCTION TELEMETRY START ===
|
|
184
|
+
[PASTE PRODUCTION ERROR LOGS, EXCEPTION DATA, MONITORING ALERTS]
|
|
185
|
+
=== PRODUCTION TELEMETRY END ===
|
|
186
|
+
|
|
187
|
+
=== HISTORICAL DEFECT DATA (if available) START ===
|
|
188
|
+
[PASTE historical defect data from previous releases]
|
|
189
|
+
=== HISTORICAL DEFECT DATA END ===
|
|
190
|
+
|
|
191
|
+
## REQUIRED OUTPUT (ALL SECTIONS MANDATORY)
|
|
192
|
+
|
|
193
|
+
### 1. Defect Trend Analysis
|
|
194
|
+
|
|
195
|
+
| Period | Defects Found | Severity Distribution | Density (per KLOC) | Trend |
|
|
196
|
+
|--------|--------------|----------------------|---------------------|-------|
|
|
197
|
+
| Current Release | X | P0:X P1:X P2:X P3:X P4:X | X.XX | - |
|
|
198
|
+
| Previous Release | X | P0:X P1:X P2:X P3:X P4:X | X.XX | - |
|
|
199
|
+
| 3-Release Average | X | P0:X P1:X P2:X P3:X P4:X | X.XX | - |
|
|
200
|
+
| 6-Release Average | X | P0:X P1:X P2:X P3:X P4:X | X.XX | - |
|
|
201
|
+
|
|
202
|
+
**DEFECT TREND DIRECTION: [declining / stable / increasing]**
|
|
203
|
+
|
|
204
|
+
### 2. Predicted Defect Density
|
|
205
|
+
|
|
206
|
+
| Prediction Horizon | Predicted Density | Confidence | Method |
|
|
207
|
+
|--------------------|-------------------|------------|--------|
|
|
208
|
+
| Next 7 days | X.XX per KLOC | High/Medium/Low | [regression/trend/pattern] |
|
|
209
|
+
| Next 30 days | X.XX per KLOC | High/Medium/Low | [regression/trend/pattern] |
|
|
210
|
+
| Next release cycle | X.XX per KLOC | High/Medium/Low | [regression/trend/pattern] |
|
|
211
|
+
|
|
212
|
+
**PREDICTED DEFECT DENSITY: X.XX per KLOC**
|
|
213
|
+
|
|
214
|
+
### 3. Hotspot Identification
|
|
215
|
+
|
|
216
|
+
| Component/Module | Defect Count | Density | Risk Rank | Contributing Factors |
|
|
217
|
+
|-----------------|-------------|---------|-----------|---------------------|
|
|
218
|
+
| [module 1] | X | X.XX | 1 (Highest) | [complexity, churn, coupling, etc.] |
|
|
219
|
+
| [module 2] | X | X.XX | 2 | [factors] |
|
|
220
|
+
| [module 3] | X | X.XX | 3 | [factors] |
|
|
221
|
+
| [module 4] | X | X.XX | 4 | [factors] |
|
|
222
|
+
| [module 5] | X | X.XX | 5 | [factors] |
|
|
223
|
+
|
|
224
|
+
### 4. Pattern Analysis
|
|
225
|
+
|
|
226
|
+
| Pattern | Occurrences | Modules Affected | Root Cause Category | Preventability |
|
|
227
|
+
|---------|-------------|-----------------|--------------------|--------------------|
|
|
228
|
+
| [pattern 1] | X | [modules] | [code/design/config/env] | High/Medium/Low |
|
|
229
|
+
| [pattern 2] | X | [modules] | [code/design/config/env] | High/Medium/Low |
|
|
230
|
+
| [pattern 3] | X | [modules] | [code/design/config/env] | High/Medium/Low |
|
|
231
|
+
|
|
232
|
+
### 5. Escape Analysis
|
|
233
|
+
|
|
234
|
+
For each defect found in production, identify which QCSD phase SHOULD have caught it:
|
|
235
|
+
|
|
236
|
+
| Defect ID | Severity | Escaped From | Why Escaped | Prevention Strategy |
|
|
237
|
+
|-----------|----------|-------------|-------------|---------------------|
|
|
238
|
+
| DEF-001 | P0/P1/P2/P3/P4 | Ideation/Refinement/Development/Verification | [why not caught] | [what to change] |
|
|
239
|
+
| DEF-002 | P0/P1/P2/P3/P4 | Ideation/Refinement/Development/Verification | [why not caught] | [what to change] |
|
|
240
|
+
|
|
241
|
+
**Escape Summary:**
|
|
242
|
+
| Escaped From Phase | Count | Percentage | Key Gap |
|
|
243
|
+
|-------------------|-------|------------|---------|
|
|
244
|
+
| Ideation | X | X% | [missing risk assessment] |
|
|
245
|
+
| Refinement | X | X% | [missing test strategy] |
|
|
246
|
+
| Development | X | X% | [missing test coverage] |
|
|
247
|
+
| Verification | X | X% | [missing pipeline check] |
|
|
248
|
+
|
|
249
|
+
**MINIMUM: Analyze defect trends, calculate density, identify at least 5 hotspots, and perform escape analysis for all defects.**
|
|
250
|
+
|
|
251
|
+
## OUTPUT FORMAT
|
|
252
|
+
|
|
253
|
+
Save your complete analysis in Markdown to:
|
|
254
|
+
${OUTPUT_FOLDER}/03-defect-prediction.md
|
|
255
|
+
|
|
256
|
+
Use the Write tool to save BEFORE completing.
|
|
257
|
+
Report MUST be complete - no placeholders.
|
|
258
|
+
|
|
259
|
+
## VALIDATION BEFORE SUBMITTING
|
|
260
|
+
|
|
261
|
+
+-- Did I analyze defect data across multiple release periods?
|
|
262
|
+
+-- Did I calculate trend direction (declining/stable/increasing)?
|
|
263
|
+
+-- Did I predict future defect density with confidence levels?
|
|
264
|
+
+-- Did I identify at least 5 defect hotspots?
|
|
265
|
+
+-- Did I perform escape analysis mapping defects to QCSD phases?
|
|
266
|
+
+-- Did I identify at least 3 defect patterns?
|
|
267
|
+
+-- Did I save the report to the correct output path?`,
|
|
268
|
+
subagent_type: "qe-defect-predictor",
|
|
269
|
+
run_in_background: true
|
|
270
|
+
})
|
|
271
|
+
```
|
|
272
|
+
|
|
273
|
+
### Agent 3: Root Cause Analyzer
|
|
274
|
+
|
|
275
|
+
**This agent MUST perform systematic RCA of all production incidents since release. Incident severity tracking is mandatory.**
|
|
276
|
+
|
|
277
|
+
```
|
|
278
|
+
Task({
|
|
279
|
+
description: "Systematic root cause analysis of production incidents",
|
|
280
|
+
prompt: `You are qe-root-cause-analyzer. Your output quality is being audited.
|
|
281
|
+
|
|
282
|
+
## PRODUCTION DATA TO ANALYZE
|
|
283
|
+
|
|
284
|
+
=== INCIDENT REPORTS START ===
|
|
285
|
+
[PASTE THE COMPLETE INCIDENT REPORTS HERE - DO NOT SUMMARIZE]
|
|
286
|
+
- All P0-P4 incidents since release
|
|
287
|
+
- Incident timelines
|
|
288
|
+
- Resolution actions
|
|
289
|
+
- Post-mortems if available
|
|
290
|
+
=== INCIDENT REPORTS END ===
|
|
291
|
+
|
|
292
|
+
=== PRODUCTION LOGS START ===
|
|
293
|
+
[PASTE RELEVANT PRODUCTION LOGS AND ERROR DATA]
|
|
294
|
+
=== PRODUCTION LOGS END ===
|
|
295
|
+
|
|
296
|
+
=== MONITORING ALERTS START ===
|
|
297
|
+
[PASTE MONITORING ALERTS AND ALERT HISTORY]
|
|
298
|
+
=== MONITORING ALERTS END ===
|
|
299
|
+
|
|
300
|
+
## REQUIRED OUTPUT (ALL SECTIONS MANDATORY)
|
|
301
|
+
|
|
302
|
+
### 1. Incident Inventory
|
|
303
|
+
|
|
304
|
+
Complete inventory of all incidents since release:
|
|
305
|
+
|
|
306
|
+
| Incident ID | Severity | Status | Summary | Duration | Impact | Detected By |
|
|
307
|
+
|-------------|----------|--------|---------|----------|--------|-------------|
|
|
308
|
+
| INC-001 | P0/P1/P2/P3/P4 | Open/Resolved/Mitigated | [summary] | X hours | [users/revenue/data] | [monitoring/user/support] |
|
|
309
|
+
| INC-002 | P0/P1/P2/P3/P4 | Open/Resolved/Mitigated | [summary] | X hours | [users/revenue/data] | [monitoring/user/support] |
|
|
310
|
+
|
|
311
|
+
**TOTAL INCIDENTS: X (P0: X, P1: X, P2: X, P3: X, P4: X)**
|
|
312
|
+
**MAXIMUM OPEN SEVERITY: [P0/P1/P2/P3/P4/NONE]**
|
|
313
|
+
|
|
314
|
+
### 2. Root Cause Analysis (per incident)
|
|
315
|
+
|
|
316
|
+
For EACH incident, provide structured RCA:
|
|
317
|
+
|
|
318
|
+
#### INC-XXX: [Title]
|
|
319
|
+
|
|
320
|
+
| RCA Dimension | Finding |
|
|
321
|
+
|---------------|---------|
|
|
322
|
+
| **What happened** | [factual description of the incident] |
|
|
323
|
+
| **Timeline** | [detection -> diagnosis -> mitigation -> resolution] |
|
|
324
|
+
| **Root cause** | [the underlying technical cause] |
|
|
325
|
+
| **Contributing factors** | [what made the incident possible or worse] |
|
|
326
|
+
| **Why not detected earlier** | [gap in monitoring, testing, or review] |
|
|
327
|
+
| **5-Why Analysis** | 1. Why? -> 2. Why? -> 3. Why? -> 4. Why? -> 5. Why? -> Root |
|
|
328
|
+
| **Category** | [code-defect/config-error/infra-failure/capacity/dependency/human-error] |
|
|
329
|
+
|
|
330
|
+
### 3. Resolution and Prevention Strategies
|
|
331
|
+
|
|
332
|
+
| Incident | Resolution Applied | Time to Resolve | Prevention Strategy | Owner | Status |
|
|
333
|
+
|----------|-------------------|----------------|--------------------|---------|----|
|
|
334
|
+
| INC-XXX | [what was done] | X hours | [what prevents recurrence] | [team] | Implemented/Planned/Backlogged |
|
|
335
|
+
|
|
336
|
+
### 4. Time to Detect and Resolve
|
|
337
|
+
|
|
338
|
+
| Incident | Time to Detect (TTD) | Time to Diagnose | Time to Mitigate | Time to Resolve (TTR) | Total Duration |
|
|
339
|
+
|----------|---------------------|-----------------|------------------|----------------------|----------------|
|
|
340
|
+
| INC-XXX | X min/hours | X min/hours | X min/hours | X min/hours | X min/hours |
|
|
341
|
+
|
|
342
|
+
**Average TTD: X hours**
|
|
343
|
+
**Average TTR: X hours**
|
|
344
|
+
|
|
345
|
+
### 5. Escape Phase Analysis
|
|
346
|
+
|
|
347
|
+
| Incident | Root Cause | Should Have Been Caught In | Why It Escaped | Gap Type |
|
|
348
|
+
|----------|-----------|---------------------------|----------------|----------|
|
|
349
|
+
| INC-XXX | [root cause] | Ideation/Refinement/Development/Verification | [reason] | Testing/Monitoring/Review/Design |
|
|
350
|
+
|
|
351
|
+
### 6. RCA Completeness
|
|
352
|
+
|
|
353
|
+
| Metric | Value |
|
|
354
|
+
|--------|-------|
|
|
355
|
+
| Total incidents requiring RCA | X |
|
|
356
|
+
| RCAs completed | X |
|
|
357
|
+
| RCA completeness | X% |
|
|
358
|
+
| Incidents with prevention plans | X |
|
|
359
|
+
| Prevention implementation rate | X% |
|
|
360
|
+
|
|
361
|
+
**RCA COMPLETENESS: X%** (completedRcas / totalIncidents * 100)
|
|
362
|
+
|
|
363
|
+
**MINIMUM: Inventory ALL incidents, perform 5-Why RCA for each P0/P1, and calculate RCA completeness percentage.**
|
|
364
|
+
|
|
365
|
+
## OUTPUT FORMAT
|
|
366
|
+
|
|
367
|
+
Save your complete analysis in Markdown to:
|
|
368
|
+
${OUTPUT_FOLDER}/04-root-cause-analysis.md
|
|
369
|
+
|
|
370
|
+
Use the Write tool to save BEFORE completing.
|
|
371
|
+
Report MUST be complete - no placeholders.
|
|
372
|
+
|
|
373
|
+
## VALIDATION BEFORE SUBMITTING
|
|
374
|
+
|
|
375
|
+
+-- Did I inventory ALL incidents (P0-P4) since the release?
|
|
376
|
+
+-- Did I record the maximum open severity?
|
|
377
|
+
+-- Did I perform 5-Why RCA for each P0/P1 incident?
|
|
378
|
+
+-- Did I document resolution and prevention for each incident?
|
|
379
|
+
+-- Did I calculate time to detect and resolve for each incident?
|
|
380
|
+
+-- Did I perform escape phase analysis?
|
|
381
|
+
+-- Did I calculate RCA completeness percentage?
|
|
382
|
+
+-- Did I save the report to the correct output path?`,
|
|
383
|
+
subagent_type: "qe-root-cause-analyzer",
|
|
384
|
+
run_in_background: true
|
|
385
|
+
})
|
|
386
|
+
```
|
|
387
|
+
|
|
388
|
+
### Post-Spawn Confirmation
|
|
389
|
+
|
|
390
|
+
After sending all three Task calls, you MUST tell the user:
|
|
391
|
+
|
|
392
|
+
```
|
|
393
|
+
I've launched 3 core agents in parallel:
|
|
394
|
+
|
|
395
|
+
qe-metrics-optimizer [Domain: learning-optimization]
|
|
396
|
+
- Computing DORA metrics (deployment frequency, lead time, MTTR, CFR)
|
|
397
|
+
- Evaluating SLA/SLO compliance across all targets
|
|
398
|
+
- Calculating composite DORA score (0-1)
|
|
399
|
+
|
|
400
|
+
qe-defect-predictor [Domain: defect-intelligence]
|
|
401
|
+
- Analyzing defect trends and predicting future density
|
|
402
|
+
- Identifying defect hotspots across modules
|
|
403
|
+
- Performing escape analysis (which phase should have caught each defect)
|
|
404
|
+
|
|
405
|
+
qe-root-cause-analyzer [Domain: defect-intelligence]
|
|
406
|
+
- Inventorying all P0-P4 incidents since release
|
|
407
|
+
- Performing systematic 5-Why RCA for each incident
|
|
408
|
+
- Calculating RCA completeness percentage
|
|
409
|
+
|
|
410
|
+
WAITING for all agents to complete before proceeding...
|
|
411
|
+
```
|
|
412
|
+
|
|
413
|
+
**DO NOT proceed to Step 3 until you have sent this confirmation.**
|
|
414
|
+
|
|
415
|
+
## Success Criteria
|
|
416
|
+
- [ ] All THREE core agents spawned in a SINGLE message
|
|
417
|
+
- [ ] Each agent received complete production data (not summaries)
|
|
418
|
+
- [ ] Post-spawn confirmation message sent to user
|
|
419
|
+
- [ ] All agents running in background
|
|
420
|
+
|
|
421
|
+
## Output
|
|
422
|
+
Provide to the next step:
|
|
423
|
+
- Confirmation that all 3 agents are spawned and running
|
|
424
|
+
- The Task IDs for tracking (if available)
|
|
425
|
+
|
|
426
|
+
## Navigation
|
|
427
|
+
- On success: proceed to Step 3 (Wait & Extract Results) by reading `steps/03-batch1-results.md`
|
|
428
|
+
- On failure: if fewer than 3 agents spawned, respawn missing agents before proceeding
|