claude-code-orchestrator-kit 1.4.0 → 1.4.15
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude/agents/business/workers/lead-research-assistant.md +199 -0
- package/.claude/agents/database/workers/database-architect.md +3 -3
- package/.claude/agents/database/workers/supabase-auditor.md +7 -7
- package/.claude/agents/development/workers/code-reviewer.md +17 -2
- package/.claude/agents/frontend/workers/nextjs-ui-designer.md +30 -0
- package/.claude/agents/health/workers/bug-fixer.md +31 -2
- package/.claude/agents/health/workers/bug-hunter.md +0 -1
- package/.claude/agents/health/workers/dead-code-hunter.md +167 -75
- package/.claude/agents/health/workers/dead-code-remover.md +217 -66
- package/.claude/agents/health/workers/dependency-auditor.md +83 -24
- package/.claude/agents/health/workers/dependency-updater.md +0 -1
- package/.claude/agents/health/workers/security-scanner.md +0 -1
- package/.claude/agents/infrastructure/workers/deployment-engineer.md +446 -0
- package/.claude/agents/infrastructure/workers/infrastructure-specialist.md +2 -2
- package/.claude/agents/meta/workers/meta-agent-v3.md +22 -0
- package/.claude/agents/testing/workers/integration-tester.md +1 -1
- package/.claude/agents/testing/workers/test-writer.md +16 -0
- package/.claude/commands/health-bugs.md +14 -281
- package/.claude/commands/health-cleanup.md +14 -281
- package/.claude/commands/health-deps.md +14 -281
- package/.claude/commands/health-metrics.md +51 -709
- package/.claude/commands/health-reuse.md +14 -311
- package/.claude/commands/health-security.md +14 -281
- package/.claude/commands/push.md +17 -3
- package/.claude/commands/speckit.implement.md +0 -11
- package/.claude/commands/speckit.taskstoissues.md +95 -5
- package/.claude/commands/worktree.md +150 -0
- package/.claude/scripts/gates/check-bundle-size.sh +0 -0
- package/.claude/scripts/gates/check-coverage.sh +0 -0
- package/.claude/scripts/gates/check-security.sh +0 -0
- package/.claude/scripts/release.sh +469 -94
- package/.claude/skills/algorithmic-art/LICENSE.txt +202 -0
- package/.claude/skills/algorithmic-art/SKILL.md +405 -0
- package/.claude/skills/algorithmic-art/templates/generator_template.js +223 -0
- package/.claude/skills/algorithmic-art/templates/viewer.html +599 -0
- package/.claude/skills/artifacts-builder/LICENSE.txt +202 -0
- package/.claude/skills/artifacts-builder/SKILL.md +74 -0
- package/.claude/skills/artifacts-builder/scripts/bundle-artifact.sh +54 -0
- package/.claude/skills/artifacts-builder/scripts/init-artifact.sh +322 -0
- package/.claude/skills/artifacts-builder/scripts/shadcn-components.tar.gz +0 -0
- package/.claude/skills/bug-health-inline/SKILL.md +221 -0
- package/.claude/skills/bug-health-inline/references/worker-prompts.md +182 -0
- package/.claude/skills/canvas-design/LICENSE.txt +202 -0
- package/.claude/skills/canvas-design/SKILL.md +130 -0
- package/.claude/skills/canvas-design/canvas-fonts/ArsenalSC-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/ArsenalSC-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/BigShoulders-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/BigShoulders-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/BigShoulders-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Boldonse-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/Boldonse-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/BricolageGrotesque-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/BricolageGrotesque-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/BricolageGrotesque-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/CrimsonPro-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/CrimsonPro-Italic.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/CrimsonPro-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/CrimsonPro-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/DMMono-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/DMMono-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/EricaOne-OFL.txt +94 -0
- package/.claude/skills/canvas-design/canvas-fonts/EricaOne-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/GeistMono-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/GeistMono-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/GeistMono-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Gloock-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/Gloock-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/IBMPlexMono-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/IBMPlexMono-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/IBMPlexMono-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/IBMPlexSerif-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/IBMPlexSerif-BoldItalic.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/IBMPlexSerif-Italic.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/IBMPlexSerif-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/InstrumentSans-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/InstrumentSans-BoldItalic.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/InstrumentSans-Italic.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/InstrumentSans-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/InstrumentSans-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/InstrumentSerif-Italic.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/InstrumentSerif-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Italiana-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/Italiana-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/JetBrainsMono-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/JetBrainsMono-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/JetBrainsMono-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Jura-Light.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Jura-Medium.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Jura-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/LibreBaskerville-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/LibreBaskerville-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Lora-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Lora-BoldItalic.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Lora-Italic.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Lora-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/Lora-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/NationalPark-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/NationalPark-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/NationalPark-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/NothingYouCouldDo-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/NothingYouCouldDo-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Outfit-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Outfit-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/Outfit-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/PixelifySans-Medium.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/PixelifySans-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/PoiretOne-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/PoiretOne-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/RedHatMono-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/RedHatMono-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/RedHatMono-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Silkscreen-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/Silkscreen-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/SmoochSans-Medium.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/SmoochSans-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/Tektur-Medium.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/Tektur-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/Tektur-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/WorkSans-Bold.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/WorkSans-BoldItalic.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/WorkSans-Italic.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/WorkSans-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/WorkSans-Regular.ttf +0 -0
- package/.claude/skills/canvas-design/canvas-fonts/YoungSerif-OFL.txt +93 -0
- package/.claude/skills/canvas-design/canvas-fonts/YoungSerif-Regular.ttf +0 -0
- package/.claude/skills/changelog-generator/SKILL.md +104 -0
- package/.claude/skills/cleanup-health-inline/SKILL.md +224 -0
- package/.claude/skills/code-reviewer/SKILL.md +209 -0
- package/.claude/skills/code-reviewer/references/code_review_checklist.md +103 -0
- package/.claude/skills/code-reviewer/references/coding_standards.md +103 -0
- package/.claude/skills/code-reviewer/references/common_antipatterns.md +103 -0
- package/.claude/skills/code-reviewer/scripts/code_quality_checker.py +114 -0
- package/.claude/skills/code-reviewer/scripts/pr_analyzer.py +114 -0
- package/.claude/skills/code-reviewer/scripts/review_report_generator.py +114 -0
- package/.claude/skills/content-research-writer/SKILL.md +538 -0
- package/.claude/skills/deps-health-inline/SKILL.md +227 -0
- package/.claude/skills/frontend-aesthetics/SKILL.md +51 -396
- package/.claude/skills/git-commit-helper/SKILL.md +203 -0
- package/.claude/skills/lead-research-assistant/SKILL.md +199 -0
- package/.claude/skills/reuse-health-inline/SKILL.md +248 -0
- package/.claude/skills/rollback-changes/SKILL.md +50 -524
- package/.claude/skills/run-quality-gate/SKILL.md +36 -346
- package/.claude/skills/security-health-inline/SKILL.md +224 -0
- package/.claude/skills/senior-devops/SKILL.md +209 -0
- package/.claude/skills/senior-devops/references/cicd_pipeline_guide.md +103 -0
- package/.claude/skills/senior-devops/references/deployment_strategies.md +103 -0
- package/.claude/skills/senior-devops/references/infrastructure_as_code.md +103 -0
- package/.claude/skills/senior-devops/scripts/deployment_manager.py +114 -0
- package/.claude/skills/senior-devops/scripts/pipeline_generator.py +114 -0
- package/.claude/skills/senior-devops/scripts/terraform_scaffolder.py +114 -0
- package/.claude/skills/senior-prompt-engineer/SKILL.md +226 -0
- package/.claude/skills/senior-prompt-engineer/references/agentic_system_design.md +80 -0
- package/.claude/skills/senior-prompt-engineer/references/llm_evaluation_frameworks.md +80 -0
- package/.claude/skills/senior-prompt-engineer/references/prompt_engineering_patterns.md +80 -0
- package/.claude/skills/senior-prompt-engineer/scripts/agent_orchestrator.py +100 -0
- package/.claude/skills/senior-prompt-engineer/scripts/prompt_optimizer.py +100 -0
- package/.claude/skills/senior-prompt-engineer/scripts/rag_evaluator.py +100 -0
- package/.claude/skills/setup-knip/SKILL.md +372 -0
- package/.claude/skills/systematic-debugging/CREATION-LOG.md +119 -0
- package/.claude/skills/systematic-debugging/SKILL.md +296 -0
- package/.claude/skills/systematic-debugging/condition-based-waiting-example.ts +158 -0
- package/.claude/skills/systematic-debugging/condition-based-waiting.md +115 -0
- package/.claude/skills/systematic-debugging/defense-in-depth.md +122 -0
- package/.claude/skills/systematic-debugging/find-polluter.sh +63 -0
- package/.claude/skills/systematic-debugging/root-cause-tracing.md +169 -0
- package/.claude/skills/systematic-debugging/test-academic.md +14 -0
- package/.claude/skills/systematic-debugging/test-pressure-1.md +58 -0
- package/.claude/skills/systematic-debugging/test-pressure-2.md +68 -0
- package/.claude/skills/systematic-debugging/test-pressure-3.md +69 -0
- package/.claude/skills/theme-factory/LICENSE.txt +202 -0
- package/.claude/skills/theme-factory/SKILL.md +59 -0
- package/.claude/skills/theme-factory/theme-showcase.pdf +0 -0
- package/.claude/skills/theme-factory/themes/arctic-frost.md +19 -0
- package/.claude/skills/theme-factory/themes/botanical-garden.md +19 -0
- package/.claude/skills/theme-factory/themes/desert-rose.md +19 -0
- package/.claude/skills/theme-factory/themes/forest-canopy.md +19 -0
- package/.claude/skills/theme-factory/themes/golden-hour.md +19 -0
- package/.claude/skills/theme-factory/themes/midnight-galaxy.md +19 -0
- package/.claude/skills/theme-factory/themes/modern-minimalist.md +19 -0
- package/.claude/skills/theme-factory/themes/ocean-depths.md +19 -0
- package/.claude/skills/theme-factory/themes/sunset-boulevard.md +19 -0
- package/.claude/skills/theme-factory/themes/tech-innovation.md +19 -0
- package/.claude/skills/ui-design-system/SKILL.md +32 -0
- package/.claude/skills/ui-design-system/scripts/design_token_generator.py +529 -0
- package/.claude/skills/ux-researcher-designer/SKILL.md +30 -0
- package/.claude/skills/ux-researcher-designer/scripts/persona_generator.py +508 -0
- package/.claude/skills/webapp-testing/LICENSE.txt +202 -0
- package/.claude/skills/webapp-testing/SKILL.md +96 -0
- package/.claude/skills/webapp-testing/examples/console_logging.py +35 -0
- package/.claude/skills/webapp-testing/examples/element_discovery.py +40 -0
- package/.claude/skills/webapp-testing/examples/static_html_automation.py +33 -0
- package/.claude/skills/webapp-testing/scripts/with_server.py +106 -0
- package/.gitignore +4 -0
- package/README.md +492 -1093
- package/README.ru.md +719 -0
- package/docs/Agents Ecosystem/AGENT-ORCHESTRATION.md +2 -2
- package/docs/{SPECKIT-GUIDE.md → COMMANDS-GUIDE.md} +252 -20
- package/docs/reports/skills/new-skills-analysis-2025-12.md +331 -0
- package/package.json +11 -3
- package/.claude/agents/health/orchestrators/bug-orchestrator.md +0 -1084
- package/.claude/agents/health/orchestrators/dead-code-orchestrator.md +0 -1064
- package/.claude/agents/health/orchestrators/dependency-orchestrator.md +0 -1064
- package/.claude/agents/health/orchestrators/reuse-orchestrator.md +0 -1112
- package/.claude/agents/health/orchestrators/security-orchestrator.md +0 -1064
- package/.claude/commands/worktree-cleanup.md +0 -382
- package/.claude/commands/worktree-create.md +0 -287
- package/.claude/commands/worktree-list.md +0 -239
- package/.claude/commands/worktree-remove.md +0 -339
- package/.claude/project-index.md +0 -75
- package/.claude/skills/load-project-context/SKILL.md +0 -89
- package/.claude/skills/resume-session/SKILL.md +0 -164
- package/.claude/skills/save-session-context/SKILL.md +0 -123
- package/.claude/templates/project-index.template.md +0 -67
- package/.claude/templates/session/context.template.md +0 -40
- package/.claude/templates/session/log.template.md +0 -72
- package/.github/BRANCH_PROTECTION.md +0 -137
- package/.github/workflows/build.yml +0 -70
- package/.github/workflows/deploy-staging.yml +0 -90
- package/.github/workflows/test.yml +0 -104
|
@@ -1,747 +1,89 @@
|
|
|
1
1
|
# Command: /health-metrics
|
|
2
2
|
|
|
3
|
-
|
|
3
|
+
Generate monthly agent ecosystem health metrics report.
|
|
4
4
|
|
|
5
|
-
##
|
|
5
|
+
## Usage
|
|
6
6
|
|
|
7
|
-
Generate comprehensive monthly metrics report showing agent performance, quality gates, complexity distribution, Context7 usage, and system health for data-driven optimization decisions.
|
|
8
|
-
|
|
9
|
-
## Process
|
|
10
|
-
|
|
11
|
-
### Step 1: Determine Reporting Period
|
|
12
|
-
|
|
13
|
-
**Default**: Current month (YYYY-MM format)
|
|
14
|
-
|
|
15
|
-
**User can specify**: Previous month or specific month
|
|
16
|
-
|
|
17
|
-
**Examples**:
|
|
18
|
-
- `/health-metrics` → Current month (2025-10)
|
|
19
|
-
- `/health-metrics 2025-09` → September 2025
|
|
20
|
-
- `/health-metrics last-month` → Previous month
|
|
21
|
-
|
|
22
|
-
### Step 2: Read Metrics Files
|
|
23
|
-
|
|
24
|
-
**Current Month**:
|
|
25
|
-
```
|
|
26
|
-
File: .tmp/metrics/YYYY-MM.json
|
|
27
|
-
```
|
|
28
|
-
|
|
29
|
-
**Previous Month** (for comparison):
|
|
30
7
|
```
|
|
31
|
-
|
|
8
|
+
/health-metrics # Current month
|
|
9
|
+
/health-metrics 2025-09 # Specific month
|
|
10
|
+
/health-metrics last-month
|
|
32
11
|
```
|
|
33
12
|
|
|
34
|
-
|
|
35
|
-
- Report: "No metrics data for {month}"
|
|
36
|
-
- Suggest: "Run agent workflows to generate metrics first"
|
|
37
|
-
- Exit gracefully
|
|
38
|
-
|
|
39
|
-
**If file corrupt**:
|
|
40
|
-
- Attempt to read backup: `.tmp/metrics/YYYY-MM.json.backup`
|
|
41
|
-
- If backup also corrupt: Report error and exit
|
|
42
|
-
- Log corruption incident
|
|
43
|
-
|
|
44
|
-
### Step 3: Analyze Metrics
|
|
45
|
-
|
|
46
|
-
Calculate key insights from metrics data.
|
|
47
|
-
|
|
48
|
-
#### Agent Performance Analysis
|
|
49
|
-
|
|
50
|
-
**For each agent**:
|
|
51
|
-
- **Success Rate**: `(successes / invocations) * 100`
|
|
52
|
-
- **Performance Trend**: Compare avg_duration vs previous month
|
|
53
|
-
- **Value Delivered**: Count of bugs/vulnerabilities/issues found
|
|
54
|
-
|
|
55
|
-
**Categorize Agents**:
|
|
56
|
-
- **Top Performers**: Success rate >= 90%
|
|
57
|
-
- **Needs Improvement**: Success rate < 70%
|
|
58
|
-
- **Underutilized**: Invocations < 5 per month
|
|
59
|
-
|
|
60
|
-
#### Orchestrator Performance Analysis
|
|
61
|
-
|
|
62
|
-
**For each orchestrator**:
|
|
63
|
-
- **Success Rate**: `(completed / runs) * 100`
|
|
64
|
-
- **Abort Rate**: `(aborted / runs) * 100`
|
|
65
|
-
- **Iteration Efficiency**: avg_iterations (lower is better)
|
|
66
|
-
- **Max Iterations Hit**: Count (indicates complexity issues)
|
|
67
|
-
|
|
68
|
-
#### Quality Gates Analysis
|
|
69
|
-
|
|
70
|
-
**For each gate (type-check, build, tests)**:
|
|
71
|
-
- **Pass Rate**: Already calculated in metrics
|
|
72
|
-
- **Trend**: Compare pass rate vs previous month
|
|
73
|
-
- **Flag Concerns**: Pass rate < 85%
|
|
74
|
-
|
|
75
|
-
#### Complexity Distribution
|
|
76
|
-
|
|
77
|
-
**Analyze complexity levels**:
|
|
78
|
-
- **Percentage by level**: Calculate % for trivial/moderate/high/critical
|
|
79
|
-
- **Research Usage**: % of high/critical that triggered research
|
|
80
|
-
- **Average Score**: Indicates overall task difficulty
|
|
81
|
-
|
|
82
|
-
#### Context7 Integration Health
|
|
83
|
-
|
|
84
|
-
**Metrics**:
|
|
85
|
-
- **Success Rate**: `(successful_queries / total_queries) * 100`
|
|
86
|
-
- **Availability**: `100 - (unavailable_events / total_invocations * 100)`
|
|
87
|
-
- **Performance**: avg_response_time_ms
|
|
88
|
-
- **Top Libraries**: Sort by query count
|
|
89
|
-
|
|
90
|
-
#### Behavioral OS Health
|
|
13
|
+
## Process
|
|
91
14
|
|
|
92
|
-
|
|
93
|
-
- Count total fallbacks
|
|
94
|
-
- Calculate % of invocations that triggered fallbacks
|
|
95
|
-
- Flag if any fallback > 5% frequency
|
|
15
|
+
### 1. Read Metrics Files
|
|
96
16
|
|
|
97
|
-
|
|
98
|
-
-
|
|
99
|
-
- Flag if any emergency occurred (should be rare)
|
|
17
|
+
- Current: `.tmp/metrics/YYYY-MM.json`
|
|
18
|
+
- Previous (comparison): `.tmp/metrics/YYYY-(MM-1).json`
|
|
100
19
|
|
|
101
|
-
|
|
102
|
-
- Should be 0 (self-diagnostics prevent violations)
|
|
103
|
-
- If > 0: Critical issue, needs investigation
|
|
20
|
+
If file missing: Report "No metrics data for {month}" and exit.
|
|
104
21
|
|
|
105
|
-
###
|
|
22
|
+
### 2. Analyze Metrics
|
|
106
23
|
|
|
107
|
-
|
|
24
|
+
**Agent Performance**:
|
|
25
|
+
- Success Rate: `(successes / invocations) * 100`
|
|
26
|
+
- Categories: Top (>=90%), Needs Improvement (<70%), Underutilized (<5 invocations)
|
|
108
27
|
|
|
109
|
-
**
|
|
110
|
-
- Total invocations (growth indicator)
|
|
111
|
-
- Overall success rate (reliability trend)
|
|
112
|
-
- Quality gate pass rates (code health trend)
|
|
113
|
-
- Context7 usage (adoption trend)
|
|
114
|
-
- Research phases triggered (complexity trend)
|
|
28
|
+
**Orchestrators**: Success rate, abort rate, avg iterations
|
|
115
29
|
|
|
116
|
-
**
|
|
117
|
-
- ⬆️ Increase
|
|
118
|
-
- ⬇️ Decrease
|
|
119
|
-
- ➡️ No change (within 2%)
|
|
30
|
+
**Quality Gates** (type-check, build, tests): Pass rate, flag if <85%
|
|
120
31
|
|
|
121
|
-
|
|
32
|
+
**Complexity Distribution**: % by level (trivial/moderate/high/critical)
|
|
122
33
|
|
|
123
|
-
|
|
34
|
+
**Context7**: Success rate, availability, avg response time, top libraries
|
|
124
35
|
|
|
125
|
-
**
|
|
126
|
-
- Specific agent improvements needed
|
|
127
|
-
- Quality gate investigations required
|
|
128
|
-
- System reliability issues
|
|
36
|
+
**Behavioral OS**: Fallback frequency (flag if >5%), emergency incidents
|
|
129
37
|
|
|
130
|
-
|
|
131
|
-
- Agent discoverability improvements
|
|
132
|
-
- Documentation updates
|
|
133
|
-
- Workflow optimizations
|
|
38
|
+
### 3. Generate Recommendations
|
|
134
39
|
|
|
135
|
-
**
|
|
136
|
-
-
|
|
137
|
-
-
|
|
138
|
-
- Feature requests
|
|
40
|
+
- **High Priority**: Success rate <70%, emergencies
|
|
41
|
+
- **Medium Priority**: Pass rate <85%, underutilization
|
|
42
|
+
- **Low Priority**: Optimizations
|
|
139
43
|
|
|
140
|
-
###
|
|
44
|
+
### 4. Create Report
|
|
141
45
|
|
|
142
46
|
**Location**: `docs/reports/metrics/YYYY-MM-ecosystem-health.md`
|
|
143
47
|
|
|
144
|
-
**
|
|
145
|
-
|
|
146
|
-
|
|
147
|
-
|
|
148
|
-
|
|
149
|
-
|
|
150
|
-
|
|
151
|
-
|
|
152
|
-
|
|
153
|
-
|
|
154
|
-
|
|
155
|
-
|
|
156
|
-
|
|
157
|
-
---
|
|
158
|
-
|
|
159
|
-
## Executive Summary
|
|
160
|
-
|
|
161
|
-
**Overall Health**: ✅ **GOOD** | ⚠️ **FAIR** | ❌ **POOR** ({success_rate}% success rate)
|
|
162
|
-
|
|
163
|
-
**Determination**:
|
|
164
|
-
- >= 90% success rate: GOOD ✅
|
|
165
|
-
- >= 75% success rate: FAIR ⚠️
|
|
166
|
-
- < 75% success rate: POOR ❌
|
|
167
|
-
|
|
168
|
-
**Highlights**:
|
|
169
|
-
- Most used agent: {agent_name} ({invocations} invocations)
|
|
170
|
-
- Best performer: {agent_name} ({success_rate}% success rate)
|
|
171
|
-
- Top concern: {agent_name} ({issue_description})
|
|
172
|
-
|
|
173
|
-
**Key Metrics**:
|
|
174
|
-
- Total bugs found: {count}
|
|
175
|
-
- Total vulnerabilities found: {count}
|
|
176
|
-
- Context7 queries: {count} ({success_rate}% success rate)
|
|
177
|
-
- Quality gates pass rate: {percent}%
|
|
178
|
-
|
|
179
|
-
---
|
|
180
|
-
|
|
181
|
-
## Agent Performance
|
|
182
|
-
|
|
183
|
-
### Top Performers ✅
|
|
184
|
-
|
|
185
|
-
For each agent with >= 90% success rate:
|
|
186
|
-
|
|
187
|
-
#### {Agent Name}
|
|
188
|
-
- **Success Rate**: {percent}% ({successes}/{invocations})
|
|
189
|
-
- **Avg Duration**: {minutes} minutes
|
|
190
|
-
- **Value**: {metric description}
|
|
191
|
-
- **Context7 Usage**: {percent}% ({queries} queries)
|
|
192
|
-
- **Trend**: {comparison to previous month}
|
|
193
|
-
|
|
194
|
-
### Needs Improvement ⚠️
|
|
195
|
-
|
|
196
|
-
For each agent with < 70% success rate:
|
|
197
|
-
|
|
198
|
-
#### {Agent Name}
|
|
199
|
-
- **Success Rate**: {percent}% ({successes}/{invocations})
|
|
200
|
-
- **Avg Duration**: {minutes} minutes
|
|
201
|
-
- **Failures**: {count} ({failure_rate}%)
|
|
202
|
-
- **Root Cause**: {analysis based on failure patterns}
|
|
203
|
-
- **Recommendation**: {specific actionable improvement}
|
|
204
|
-
|
|
205
|
-
### Underutilized 📊
|
|
206
|
-
|
|
207
|
-
For each agent with < 5 invocations:
|
|
208
|
-
|
|
209
|
-
#### {Agent Name}
|
|
210
|
-
- **Invocations**: Only {count} (lowest usage)
|
|
211
|
-
- **Success Rate**: {percent}% ({successes}/{invocations})
|
|
212
|
-
- **Value**: {metric description}
|
|
213
|
-
- **Recommendation**: {discoverability/documentation improvements}
|
|
214
|
-
|
|
215
|
-
---
|
|
216
|
-
|
|
217
|
-
## Orchestrator Performance
|
|
218
|
-
|
|
219
|
-
| Orchestrator | Runs | Completed | Aborted | Success Rate | Avg Duration | Avg Iterations |
|
|
220
|
-
|--------------|------|-----------|---------|--------------|--------------|----------------|
|
|
221
|
-
| {name} | {runs} | {completed} | {aborted} | {percent}% | {minutes} min | {iterations} |
|
|
222
|
-
|
|
223
|
-
**Insights**:
|
|
224
|
-
- {Analysis of orchestrator patterns}
|
|
225
|
-
- {Concerns about abort rates or iterations}
|
|
226
|
-
- {Recommendations for improvements}
|
|
227
|
-
|
|
228
|
-
---
|
|
229
|
-
|
|
230
|
-
## Quality Gates
|
|
231
|
-
|
|
232
|
-
| Gate | Runs | Passes | Failures | Pass Rate | Avg Duration |
|
|
233
|
-
|------|------|--------|----------|-----------|--------------|
|
|
234
|
-
| type-check | {runs} | {passes} | {failures} | {percent}% {status} | {seconds}s |
|
|
235
|
-
| build | {runs} | {passes} | {failures} | {percent}% {status} | {seconds}s |
|
|
236
|
-
| tests | {runs} | {passes} | {failures} | {percent}% {status} | {seconds}s |
|
|
237
|
-
|
|
238
|
-
**Status Indicators**:
|
|
239
|
-
- ✅ Pass rate >= 90%
|
|
240
|
-
- ⚠️ Pass rate 75-89%
|
|
241
|
-
- ❌ Pass rate < 75%
|
|
242
|
-
|
|
243
|
-
**Concerns**:
|
|
244
|
-
For each gate with pass rate < 85%:
|
|
245
|
-
- **{Gate Name}**: {percent}% pass rate (below 90% target)
|
|
246
|
-
- Investigation needed: {reason for failures}
|
|
247
|
-
- Recommendation: {specific action}
|
|
248
|
-
|
|
249
|
-
---
|
|
250
|
-
|
|
251
|
-
## Complexity Distribution
|
|
252
|
-
|
|
253
|
-
**Tasks Analyzed**: {count}
|
|
254
|
-
|
|
255
|
-
| Level | Count | % | Research Triggered |
|
|
256
|
-
|-------|-------|---|--------------------|
|
|
257
|
-
| Trivial (0-3) | {count} | {percent}% | {count} |
|
|
258
|
-
| Moderate (4-6) | {count} | {percent}% | {count} |
|
|
259
|
-
| High (7-8) | {count} | {percent}% | {count} |
|
|
260
|
-
| Critical (9-10) | {count} | {percent}% | {count} |
|
|
261
|
-
|
|
262
|
-
**Insights**:
|
|
263
|
-
- Most tasks are {level} complexity ({percent}%)
|
|
264
|
-
- Research phase used {appropriately|too often|too rarely}
|
|
265
|
-
- Avg complexity score: {score} ({level})
|
|
266
|
-
|
|
267
|
-
**Analysis**:
|
|
268
|
-
- If avg score > 6: Codebase has many complex issues, consider dedicated research time
|
|
269
|
-
- If avg score < 4: Mostly simple fixes, direct workflow is efficient
|
|
270
|
-
- If research triggered for trivial/moderate: Scoring calibration needed
|
|
271
|
-
|
|
272
|
-
---
|
|
273
|
-
|
|
274
|
-
## Context7 Integration
|
|
275
|
-
|
|
276
|
-
**Total Queries**: {count}
|
|
277
|
-
**Success Rate**: {percent}% ({successes}/{total})
|
|
278
|
-
**Avg Response Time**: {seconds} seconds
|
|
279
|
-
**Unavailable Events**: {count} ({percent}% of time)
|
|
280
|
-
|
|
281
|
-
**Top Libraries Queried**:
|
|
282
|
-
1. {Library}: {count} queries ({percent}%)
|
|
283
|
-
2. {Library}: {count} queries ({percent}%)
|
|
284
|
-
3. {Library}: {count} queries ({percent}%)
|
|
285
|
-
4. {Library}: {count} queries ({percent}%)
|
|
286
|
-
5. {Library}: {count} queries ({percent}%)
|
|
287
|
-
|
|
288
|
-
**Performance**: {EXCELLENT|GOOD|FAIR|POOR}
|
|
289
|
-
|
|
290
|
-
**Determination**:
|
|
291
|
-
- Success rate >= 95% AND response time < 2s: EXCELLENT ✅
|
|
292
|
-
- Success rate >= 90% AND response time < 3s: GOOD ✅
|
|
293
|
-
- Success rate >= 80% OR response time < 5s: FAIR ⚠️
|
|
294
|
-
- Otherwise: POOR ❌
|
|
295
|
-
|
|
296
|
-
**Concerns** (if any):
|
|
297
|
-
- If success rate < 95%: {analysis and recommendation}
|
|
298
|
-
- If response time > 2s: {analysis and recommendation}
|
|
299
|
-
- If unavailable > 1%: {analysis and recommendation}
|
|
300
|
-
|
|
301
|
-
---
|
|
302
|
-
|
|
303
|
-
## Token Efficiency
|
|
304
|
-
|
|
305
|
-
**Estimated Conversations**: {count}
|
|
306
|
-
**Minimal MCP Mode**: {count} ({percent}%)
|
|
307
|
-
**Full MCP Mode**: {count} ({percent}%)
|
|
308
|
-
|
|
309
|
-
**Token Savings**:
|
|
310
|
-
- Avg tokens saved per conversation: ~{count}
|
|
311
|
-
- Total tokens saved (estimated): ~{count}
|
|
312
|
-
- **ROI**: Minimal MCP mode reduces token usage by ~{percent}% per conversation
|
|
313
|
-
|
|
314
|
-
**Analysis**:
|
|
315
|
-
- {percent}% of conversations use minimal mode (target: >85%)
|
|
316
|
-
- Estimated savings: {count} tokens/month
|
|
317
|
-
- {Recommendations for optimizing MCP usage}
|
|
318
|
-
|
|
319
|
-
---
|
|
320
|
-
|
|
321
|
-
## Behavioral OS Health
|
|
322
|
-
|
|
323
|
-
### Fallback Strategies Triggered
|
|
324
|
-
|
|
325
|
-
| Fallback | Count | % of Invocations |
|
|
326
|
-
|----------|-------|------------------|
|
|
327
|
-
| Context7 unavailable | {count} | {percent}% |
|
|
328
|
-
| Quality gate failure | {count} | {percent}% |
|
|
329
|
-
| Max iterations reached | {count} | {percent}% |
|
|
330
|
-
| Worker failure | {count} | {percent}% |
|
|
331
|
-
| Plan invalid | {count} | {percent}% |
|
|
332
|
-
|
|
333
|
-
**Analysis**: {HEALTHY|CONCERNING|CRITICAL}
|
|
334
|
-
|
|
335
|
-
**Determination**:
|
|
336
|
-
- All fallbacks < 5%: HEALTHY ✅
|
|
337
|
-
- Any fallback 5-10%: CONCERNING ⚠️
|
|
338
|
-
- Any fallback > 10%: CRITICAL ❌
|
|
339
|
-
|
|
340
|
-
**Concerns** (if any):
|
|
341
|
-
For each fallback > 5%:
|
|
342
|
-
- **{Fallback Type}**: {percent}% frequency
|
|
343
|
-
- Root cause: {analysis}
|
|
344
|
-
- Recommendation: {action to reduce frequency}
|
|
345
|
-
|
|
346
|
-
### Emergency Protocols Triggered
|
|
347
|
-
|
|
348
|
-
| Emergency | Count |
|
|
349
|
-
|-----------|-------|
|
|
350
|
-
| Infinite loop | {count} |
|
|
351
|
-
| File corruption | {count} |
|
|
352
|
-
| Token exhaustion | {count} |
|
|
353
|
-
| Concurrent conflict | {count} |
|
|
354
|
-
|
|
355
|
-
**Analysis**: {EXCELLENT|CONCERNING|CRITICAL}
|
|
356
|
-
|
|
357
|
-
**Determination**:
|
|
358
|
-
- Zero emergencies: EXCELLENT ✅
|
|
359
|
-
- 1-2 emergencies: CONCERNING ⚠️
|
|
360
|
-
- > 2 emergencies: CRITICAL ❌
|
|
361
|
-
|
|
362
|
-
**Incidents** (if any):
|
|
363
|
-
For each emergency > 0:
|
|
364
|
-
- **{Emergency Type}**: {count} incident(s)
|
|
365
|
-
- Details: {from emergency metadata if available}
|
|
366
|
-
- Impact: {analysis}
|
|
367
|
-
- Prevention: {recommendation}
|
|
368
|
-
|
|
369
|
-
### Prime Directive Violations
|
|
370
|
-
|
|
371
|
-
**Count**: {count} {flagged and prevented|CRITICAL - violations occurred}
|
|
372
|
-
|
|
373
|
-
**Status**:
|
|
374
|
-
- 0 violations: ✅ **EXCELLENT** (self-diagnostics working)
|
|
375
|
-
- > 0 violations: ❌ **CRITICAL** (system integrity compromised)
|
|
376
|
-
|
|
377
|
-
**Details** (if > 0):
|
|
378
|
-
For each violation:
|
|
379
|
-
1. {PD-X violation description}
|
|
380
|
-
- Agent: {name}
|
|
381
|
-
- When: {timestamp}
|
|
382
|
-
- How caught: {self-diagnostics|manual detection}
|
|
383
|
-
- Impact: {user impact assessment}
|
|
384
|
-
- Fix: {what was done to prevent}
|
|
385
|
-
|
|
386
|
-
---
|
|
387
|
-
|
|
388
|
-
## Recommendations
|
|
389
|
-
|
|
390
|
-
### High Priority
|
|
391
|
-
|
|
392
|
-
For critical issues (success rate < 70%, emergencies, violations):
|
|
393
|
-
|
|
394
|
-
1. **{Recommendation Title}**
|
|
395
|
-
- Issue: {specific problem}
|
|
396
|
-
- Impact: {why it matters}
|
|
397
|
-
- Action: {what to do}
|
|
398
|
-
- Target: {measurable goal}
|
|
399
|
-
|
|
400
|
-
### Medium Priority
|
|
401
|
-
|
|
402
|
-
For important improvements (pass rate < 85%, underutilization):
|
|
403
|
-
|
|
404
|
-
2. **{Recommendation Title}**
|
|
405
|
-
- Issue: {specific problem}
|
|
406
|
-
- Impact: {why it matters}
|
|
407
|
-
- Action: {what to do}
|
|
408
|
-
- Target: {measurable goal}
|
|
409
|
-
|
|
410
|
-
### Low Priority
|
|
411
|
-
|
|
412
|
-
For optimizations (nice-to-have improvements):
|
|
413
|
-
|
|
414
|
-
3. **{Recommendation Title}**
|
|
415
|
-
- Opportunity: {what could be better}
|
|
416
|
-
- Benefit: {value of improvement}
|
|
417
|
-
- Action: {what to do}
|
|
418
|
-
|
|
419
|
-
---
|
|
420
|
-
|
|
421
|
-
## Trend Analysis (vs. {Previous Month})
|
|
422
|
-
|
|
423
|
-
| Metric | {Current Month} | {Previous Month} | Change |
|
|
424
|
-
|--------|-----------------|------------------|--------|
|
|
425
|
-
| Total invocations | {count} | {count} | {percent}% {indicator} |
|
|
426
|
-
| Success rate | {percent}% | {percent}% | {percent}% {indicator} |
|
|
427
|
-
| Context7 usage | {percent}% | {percent}% | {percent}% {indicator} |
|
|
428
|
-
| Quality gate pass rate | {percent}% | {percent}% | {percent}% {indicator} |
|
|
429
|
-
| Research phases | {count} | {count} | {percent}% {indicator} |
|
|
430
|
-
|
|
431
|
-
**Insights**:
|
|
432
|
-
- Ecosystem usage {growing|stable|declining} ({indicator} invocations)
|
|
433
|
-
- Reliability {improving|stable|declining} ({indicator} success rate)
|
|
434
|
-
- Complexity {increasing|stable|decreasing} ({indicator} research phases)
|
|
435
|
-
|
|
436
|
-
**Analysis**:
|
|
437
|
-
- {Interpretation of trends}
|
|
438
|
-
- {What's working well}
|
|
439
|
-
- {What needs attention}
|
|
440
|
-
|
|
441
|
-
---
|
|
48
|
+
**Report Sections**:
|
|
49
|
+
1. Executive Summary (Overall Health: GOOD >=90% | FAIR >=75% | POOR <75%)
|
|
50
|
+
2. Agent Performance (Top Performers, Needs Improvement, Underutilized)
|
|
51
|
+
3. Orchestrator Performance (table with runs, success rate, iterations)
|
|
52
|
+
4. Quality Gates (table with pass rates, status indicators)
|
|
53
|
+
5. Complexity Distribution (table by level)
|
|
54
|
+
6. Context7 Integration (queries, success rate, top libraries)
|
|
55
|
+
7. Token Efficiency (minimal vs full MCP mode)
|
|
56
|
+
8. Behavioral OS Health (fallbacks, emergencies, violations)
|
|
57
|
+
9. Recommendations (prioritized)
|
|
58
|
+
10. Trend Analysis (vs previous month with indicators)
|
|
59
|
+
11. Conclusion (overall status, next steps)
|
|
442
60
|
|
|
443
|
-
|
|
61
|
+
**Trend Indicators**: Change >2% = increase, <-2% = decrease, else stable
|
|
444
62
|
|
|
445
|
-
**
|
|
63
|
+
**Health Determination**:
|
|
64
|
+
- HEALTHY AND IMPROVING: >=90% + no emergencies + positive trends
|
|
65
|
+
- HEALTHY: >=80% + <2 emergencies
|
|
66
|
+
- NEEDS ATTENTION: 70-79% OR 2-5 emergencies
|
|
67
|
+
- CRITICAL: <70% OR >5 emergencies
|
|
446
68
|
|
|
447
|
-
|
|
448
|
-
- Success rate >= 90% AND no emergencies AND positive trends: HEALTHY AND IMPROVING ✅
|
|
449
|
-
- Success rate >= 80% AND < 2 emergencies: HEALTHY ✅
|
|
450
|
-
- Success rate 70-79% OR 2-5 emergencies: NEEDS ATTENTION ⚠️
|
|
451
|
-
- Success rate < 70% OR > 5 emergencies: CRITICAL ❌
|
|
69
|
+
### 5. Output Summary
|
|
452
70
|
|
|
453
|
-
**Summary**:
|
|
454
|
-
{1-2 paragraph summary of ecosystem health, key achievements, main concerns, and overall trajectory}
|
|
455
|
-
|
|
456
|
-
**Next Steps**:
|
|
457
|
-
1. {Most important action item with timeline}
|
|
458
|
-
2. {Second most important action with timeline}
|
|
459
|
-
3. {When to re-evaluate metrics}
|
|
460
|
-
|
|
461
|
-
---
|
|
462
|
-
|
|
463
|
-
## Appendix: Raw Data
|
|
464
|
-
|
|
465
|
-
**Metrics File**: `.tmp/metrics/{YYYY-MM}.json`
|
|
466
|
-
|
|
467
|
-
To view detailed raw metrics:
|
|
468
|
-
```bash
|
|
469
|
-
cat .tmp/metrics/{YYYY-MM}.json | jq .
|
|
470
|
-
```
|
|
471
|
-
|
|
472
|
-
To compare with previous month:
|
|
473
|
-
```bash
|
|
474
|
-
diff <(cat .tmp/metrics/{YYYY-MM-1}.json | jq .) <(cat .tmp/metrics/{YYYY-MM}.json | jq .)
|
|
475
71
|
```
|
|
476
|
-
|
|
477
|
-
|
|
478
|
-
### Step 7: Display Report Location
|
|
479
|
-
|
|
480
|
-
Report successful generation to user.
|
|
481
|
-
|
|
482
|
-
**Message**:
|
|
483
|
-
```
|
|
484
|
-
✅ Metrics report generated successfully
|
|
485
|
-
|
|
486
|
-
Report: docs/reports/metrics/{YYYY-MM}-ecosystem-health.md
|
|
487
|
-
|
|
488
|
-
Summary:
|
|
72
|
+
Report: docs/reports/metrics/YYYY-MM-ecosystem-health.md
|
|
489
73
|
- Overall Health: {status}
|
|
490
74
|
- Total Invocations: {count}
|
|
491
75
|
- Success Rate: {percent}%
|
|
492
|
-
- Top Performer: {
|
|
493
|
-
- Top Concern: {issue
|
|
494
|
-
|
|
495
|
-
View full report:
|
|
496
|
-
cat docs/reports/metrics/{YYYY-MM}-ecosystem-health.md
|
|
76
|
+
- Top Performer: {agent}
|
|
77
|
+
- Top Concern: {issue}
|
|
497
78
|
```
|
|
498
79
|
|
|
499
|
-
---
|
|
500
|
-
|
|
501
80
|
## Error Handling
|
|
502
81
|
|
|
503
|
-
|
|
504
|
-
|
|
505
|
-
**
|
|
506
|
-
|
|
507
|
-
**Action**:
|
|
508
|
-
```
|
|
509
|
-
❌ No metrics data for {month}
|
|
510
|
-
|
|
511
|
-
Metrics file not found: .tmp/metrics/{YYYY-MM}.json
|
|
512
|
-
|
|
513
|
-
This means no agent workflows were run during {month}.
|
|
514
|
-
|
|
515
|
-
To generate metrics:
|
|
516
|
-
1. Run agent workflows: /health-bugs, /health-security, etc.
|
|
517
|
-
2. Agents automatically record metrics via record-metrics Skill
|
|
518
|
-
3. Re-run /health-metrics after workflows complete
|
|
519
|
-
|
|
520
|
-
Note: Metrics are stored monthly in .tmp/metrics/ directory.
|
|
521
|
-
```
|
|
522
|
-
|
|
523
|
-
### Corrupt Metrics File
|
|
524
|
-
|
|
525
|
-
**Issue**: Metrics file exists but has invalid JSON
|
|
526
|
-
|
|
527
|
-
**Action**:
|
|
528
|
-
```
|
|
529
|
-
⛔ Metrics file corrupt
|
|
530
|
-
|
|
531
|
-
File: .tmp/metrics/{YYYY-MM}.json
|
|
532
|
-
Error: Invalid JSON (SyntaxError: ...)
|
|
533
|
-
|
|
534
|
-
Attempting to read backup...
|
|
535
|
-
```
|
|
536
|
-
|
|
537
|
-
If backup exists and valid:
|
|
538
|
-
```
|
|
539
|
-
✅ Restored from backup
|
|
540
|
-
|
|
541
|
-
Backup: .tmp/metrics/{YYYY-MM}.json.backup
|
|
542
|
-
Status: Valid
|
|
543
|
-
|
|
544
|
-
Generating report from backup data...
|
|
545
|
-
```
|
|
546
|
-
|
|
547
|
-
If backup also corrupt:
|
|
548
|
-
```
|
|
549
|
-
❌ Backup also corrupt or not found
|
|
550
|
-
|
|
551
|
-
Cannot generate report from corrupted data.
|
|
552
|
-
|
|
553
|
-
Options:
|
|
554
|
-
1. Review .tmp/metrics/{YYYY-MM}.json manually
|
|
555
|
-
2. Delete corrupt file and start fresh next month
|
|
556
|
-
3. Report this issue (file corruption shouldn't happen)
|
|
557
|
-
|
|
558
|
-
File corruption may indicate:
|
|
559
|
-
- Concurrent write conflict
|
|
560
|
-
- Disk I/O error
|
|
561
|
-
- System crash during metrics recording
|
|
562
|
-
```
|
|
563
|
-
|
|
564
|
-
### Report Generation Failed
|
|
565
|
-
|
|
566
|
-
**Issue**: Error creating report file
|
|
567
|
-
|
|
568
|
-
**Action**:
|
|
569
|
-
```
|
|
570
|
-
⛔ Report generation failed
|
|
571
|
-
|
|
572
|
-
Target: docs/reports/metrics/{YYYY-MM}-ecosystem-health.md
|
|
573
|
-
Error: {error message}
|
|
574
|
-
|
|
575
|
-
Possible causes:
|
|
576
|
-
- Insufficient disk space
|
|
577
|
-
- Permission denied (check docs/reports/metrics/ permissions)
|
|
578
|
-
- Disk I/O error
|
|
579
|
-
|
|
580
|
-
Recommendation:
|
|
581
|
-
1. Check disk space: df -h
|
|
582
|
-
2. Check permissions: ls -la docs/reports/
|
|
583
|
-
3. Retry after resolving issue
|
|
584
|
-
```
|
|
585
|
-
|
|
586
|
-
---
|
|
587
|
-
|
|
588
|
-
## Examples
|
|
589
|
-
|
|
590
|
-
### Example 1: Current Month Report
|
|
591
|
-
|
|
592
|
-
**Command**: `/health-metrics`
|
|
593
|
-
|
|
594
|
-
**Actions**:
|
|
595
|
-
1. Determine current month: 2025-10
|
|
596
|
-
2. Read `.tmp/metrics/2025-10.json`
|
|
597
|
-
3. Read `.tmp/metrics/2025-09.json` (previous month for comparison)
|
|
598
|
-
4. Analyze all metrics sections
|
|
599
|
-
5. Calculate trends (vs September)
|
|
600
|
-
6. Generate recommendations
|
|
601
|
-
7. Write report to `docs/reports/metrics/2025-10-ecosystem-health.md`
|
|
602
|
-
|
|
603
|
-
**Output**:
|
|
604
|
-
```
|
|
605
|
-
✅ Metrics report generated successfully
|
|
606
|
-
|
|
607
|
-
Report: docs/reports/metrics/2025-10-ecosystem-health.md
|
|
608
|
-
|
|
609
|
-
Summary:
|
|
610
|
-
- Overall Health: HEALTHY AND IMPROVING ✅
|
|
611
|
-
- Total Invocations: 150
|
|
612
|
-
- Success Rate: 91%
|
|
613
|
-
- Top Performer: security-scanner (100% success rate)
|
|
614
|
-
- Top Concern: dependency-updater (70% success rate)
|
|
615
|
-
|
|
616
|
-
View full report:
|
|
617
|
-
cat docs/reports/metrics/2025-10-ecosystem-health.md
|
|
618
|
-
```
|
|
619
|
-
|
|
620
|
-
### Example 2: Previous Month Report
|
|
621
|
-
|
|
622
|
-
**Command**: `/health-metrics last-month`
|
|
623
|
-
|
|
624
|
-
**Actions**:
|
|
625
|
-
1. Determine previous month: 2025-09
|
|
626
|
-
2. Read `.tmp/metrics/2025-09.json`
|
|
627
|
-
3. Read `.tmp/metrics/2025-08.json` (for comparison)
|
|
628
|
-
4. Generate report for September
|
|
629
|
-
|
|
630
|
-
**Output**:
|
|
631
|
-
```
|
|
632
|
-
✅ Metrics report generated successfully
|
|
633
|
-
|
|
634
|
-
Report: docs/reports/metrics/2025-09-ecosystem-health.md
|
|
635
|
-
|
|
636
|
-
Summary:
|
|
637
|
-
- Overall Health: HEALTHY ✅
|
|
638
|
-
- Total Invocations: 132
|
|
639
|
-
- Success Rate: 88%
|
|
640
|
-
- Top Performer: security-scanner (100% success rate)
|
|
641
|
-
- Top Concern: dependency-updater (65% success rate)
|
|
642
|
-
```
|
|
643
|
-
|
|
644
|
-
### Example 3: Specific Month
|
|
645
|
-
|
|
646
|
-
**Command**: `/health-metrics 2025-08`
|
|
647
|
-
|
|
648
|
-
**Actions**:
|
|
649
|
-
1. Parse month: 2025-08
|
|
650
|
-
2. Read `.tmp/metrics/2025-08.json`
|
|
651
|
-
3. Read `.tmp/metrics/2025-07.json` (for comparison)
|
|
652
|
-
4. Generate report for August
|
|
653
|
-
|
|
654
|
-
### Example 4: No Data Available
|
|
655
|
-
|
|
656
|
-
**Command**: `/health-metrics 2025-07`
|
|
657
|
-
|
|
658
|
-
**Actions**:
|
|
659
|
-
1. Attempt to read `.tmp/metrics/2025-07.json`
|
|
660
|
-
2. File not found
|
|
661
|
-
|
|
662
|
-
**Output**:
|
|
663
|
-
```
|
|
664
|
-
❌ No metrics data for July 2025
|
|
665
|
-
|
|
666
|
-
Metrics file not found: .tmp/metrics/2025-07.json
|
|
667
|
-
|
|
668
|
-
This means no agent workflows were run during July 2025.
|
|
669
|
-
|
|
670
|
-
To generate metrics:
|
|
671
|
-
1. Run agent workflows: /health-bugs, /health-security, etc.
|
|
672
|
-
2. Agents automatically record metrics via record-metrics Skill
|
|
673
|
-
3. Re-run /health-metrics after workflows complete
|
|
674
|
-
```
|
|
675
|
-
|
|
676
|
-
---
|
|
677
|
-
|
|
678
|
-
## Implementation Notes
|
|
679
|
-
|
|
680
|
-
### Month Calculation
|
|
681
|
-
|
|
682
|
-
**Current Month**:
|
|
683
|
-
```
|
|
684
|
-
Today: 2025-10-21
|
|
685
|
-
Current month: 2025-10
|
|
686
|
-
```
|
|
687
|
-
|
|
688
|
-
**Previous Month**:
|
|
689
|
-
```
|
|
690
|
-
Current: 2025-10
|
|
691
|
-
Previous: 2025-09
|
|
692
|
-
|
|
693
|
-
Edge case (January):
|
|
694
|
-
Current: 2025-01
|
|
695
|
-
Previous: 2024-12
|
|
696
|
-
```
|
|
697
|
-
|
|
698
|
-
### Health Status Determination
|
|
699
|
-
|
|
700
|
-
**Agent Success Rate**:
|
|
701
|
-
- >= 90%: Top Performer ✅
|
|
702
|
-
- 70-89%: Acceptable
|
|
703
|
-
- < 70%: Needs Improvement ⚠️
|
|
704
|
-
|
|
705
|
-
**Overall System Health**:
|
|
706
|
-
- >= 90% success rate + no emergencies + positive trends: HEALTHY AND IMPROVING ✅
|
|
707
|
-
- >= 80% success rate + < 2 emergencies: HEALTHY ✅
|
|
708
|
-
- 70-79% success rate OR 2-5 emergencies: NEEDS ATTENTION ⚠️
|
|
709
|
-
- < 70% success rate OR > 5 emergencies: CRITICAL ❌
|
|
710
|
-
|
|
711
|
-
### Report File Naming
|
|
712
|
-
|
|
713
|
-
**Format**: `{YYYY-MM}-ecosystem-health.md`
|
|
714
|
-
|
|
715
|
-
**Examples**:
|
|
716
|
-
- `2025-10-ecosystem-health.md`
|
|
717
|
-
- `2025-09-ecosystem-health.md`
|
|
718
|
-
|
|
719
|
-
### Trend Indicators
|
|
720
|
-
|
|
721
|
-
**Calculation**:
|
|
722
|
-
```
|
|
723
|
-
Change % = ((New - Old) / Old) * 100
|
|
724
|
-
|
|
725
|
-
If change > 2%: ⬆️ (increase)
|
|
726
|
-
If change < -2%: ⬇️ (decrease)
|
|
727
|
-
If change between -2% and 2%: ➡️ (stable)
|
|
728
|
-
```
|
|
729
|
-
|
|
730
|
-
---
|
|
731
|
-
|
|
732
|
-
## Benefits
|
|
733
|
-
|
|
734
|
-
✅ **Visibility**: Clear view of ecosystem health each month
|
|
735
|
-
✅ **Trends**: Track improvements (or regressions) over time
|
|
736
|
-
✅ **Data-Driven**: Make optimization decisions based on real metrics
|
|
737
|
-
✅ **Accountability**: Demonstrate ROI with concrete numbers
|
|
738
|
-
✅ **Early Detection**: Flag issues before they become critical
|
|
739
|
-
✅ **Transparency**: Share ecosystem health with team/stakeholders
|
|
740
|
-
|
|
741
|
-
---
|
|
82
|
+
- **No data**: Exit with suggestion to run agent workflows
|
|
83
|
+
- **Corrupt file**: Try backup `.tmp/metrics/YYYY-MM.json.backup`
|
|
84
|
+
- **Write failure**: Check disk space and permissions
|
|
742
85
|
|
|
743
86
|
## Related
|
|
744
87
|
|
|
745
|
-
- `record-metrics` Skill: Records events
|
|
746
|
-
- `.tmp/metrics/YYYY-MM.json`: Monthly
|
|
747
|
-
- CLAUDE.md PART 5: Self-Diagnostics uses metrics for validation
|
|
88
|
+
- `record-metrics` Skill: Records events to metrics files
|
|
89
|
+
- `.tmp/metrics/YYYY-MM.json`: Monthly data files
|