agentic-qe 1.3.2 β†’ 1.3.4

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (126) hide show
  1. package/.claude/agents/qe-api-contract-validator.md +20 -0
  2. package/.claude/agents/qe-chaos-engineer.md +20 -0
  3. package/.claude/agents/qe-coverage-analyzer.md +21 -0
  4. package/.claude/agents/qe-deployment-readiness.md +20 -0
  5. package/.claude/agents/qe-flaky-test-hunter.md +20 -0
  6. package/.claude/agents/qe-fleet-commander.md +20 -0
  7. package/.claude/agents/qe-performance-tester.md +21 -0
  8. package/.claude/agents/qe-production-intelligence.md +20 -0
  9. package/.claude/agents/qe-quality-analyzer.md +20 -0
  10. package/.claude/agents/qe-quality-gate.md +20 -0
  11. package/.claude/agents/qe-regression-risk-analyzer.md +20 -0
  12. package/.claude/agents/qe-requirements-validator.md +20 -0
  13. package/.claude/agents/qe-security-scanner.md +21 -0
  14. package/.claude/agents/qe-test-data-architect.md +19 -0
  15. package/.claude/agents/qe-test-executor.md +20 -0
  16. package/.claude/agents/qe-test-generator.md +22 -0
  17. package/.claude/agents/qe-visual-tester.md +22 -0
  18. package/CHANGELOG.md +114 -0
  19. package/README.md +322 -991
  20. package/README.md.backup-20251026 +1366 -0
  21. package/bin/aqe-mcp +65 -0
  22. package/dist/agents/BaseAgent.js +1 -1
  23. package/dist/agents/BaseAgent.js.map +1 -1
  24. package/dist/agents/CoverageAnalyzerAgent.js +16 -16
  25. package/dist/agents/CoverageAnalyzerAgent.js.map +1 -1
  26. package/dist/agents/FlakyTestHunterAgent.js +1 -1
  27. package/dist/agents/FlakyTestHunterAgent.js.map +1 -1
  28. package/dist/cli/commands/init.d.ts.map +1 -1
  29. package/dist/cli/commands/init.js +71 -37
  30. package/dist/cli/commands/init.js.map +1 -1
  31. package/dist/core/memory/EnhancedAgentDBService.d.ts +127 -0
  32. package/dist/core/memory/EnhancedAgentDBService.d.ts.map +1 -0
  33. package/dist/core/memory/EnhancedAgentDBService.js +298 -0
  34. package/dist/core/memory/EnhancedAgentDBService.js.map +1 -0
  35. package/dist/core/neural/NeuralTrainer.js +2 -2
  36. package/dist/core/neural/NeuralTrainer.js.map +1 -1
  37. package/dist/learning/FixRecommendationEngine.d.ts +68 -0
  38. package/dist/learning/FixRecommendationEngine.d.ts.map +1 -0
  39. package/dist/learning/FixRecommendationEngine.js +500 -0
  40. package/dist/learning/FixRecommendationEngine.js.map +1 -0
  41. package/dist/learning/FlakyTestDetector.d.ts +19 -0
  42. package/dist/learning/FlakyTestDetector.d.ts.map +1 -1
  43. package/dist/learning/FlakyTestDetector.js +121 -2
  44. package/dist/learning/FlakyTestDetector.js.map +1 -1
  45. package/dist/learning/index.d.ts +2 -0
  46. package/dist/learning/index.d.ts.map +1 -1
  47. package/dist/learning/index.js +5 -0
  48. package/dist/learning/index.js.map +1 -1
  49. package/dist/learning/types.d.ts +11 -0
  50. package/dist/learning/types.d.ts.map +1 -1
  51. package/dist/reasoning/PatternQualityScorer.d.ts +134 -0
  52. package/dist/reasoning/PatternQualityScorer.d.ts.map +1 -0
  53. package/dist/reasoning/PatternQualityScorer.js +340 -0
  54. package/dist/reasoning/PatternQualityScorer.js.map +1 -0
  55. package/dist/reasoning/QEReasoningBank.d.ts +51 -4
  56. package/dist/reasoning/QEReasoningBank.d.ts.map +1 -1
  57. package/dist/reasoning/QEReasoningBank.js +173 -11
  58. package/dist/reasoning/QEReasoningBank.js.map +1 -1
  59. package/dist/reasoning/VectorSimilarity.d.ts +131 -0
  60. package/dist/reasoning/VectorSimilarity.d.ts.map +1 -0
  61. package/dist/reasoning/VectorSimilarity.js +250 -0
  62. package/dist/reasoning/VectorSimilarity.js.map +1 -0
  63. package/dist/reasoning/index.d.ts +8 -1
  64. package/dist/reasoning/index.d.ts.map +1 -1
  65. package/dist/reasoning/index.js +13 -2
  66. package/dist/reasoning/index.js.map +1 -1
  67. package/dist/streaming/BaseStreamHandler.d.ts +89 -0
  68. package/dist/streaming/BaseStreamHandler.d.ts.map +1 -0
  69. package/dist/streaming/BaseStreamHandler.js +168 -0
  70. package/dist/streaming/BaseStreamHandler.js.map +1 -0
  71. package/dist/streaming/TestGenerateStreamHandler.d.ts +103 -0
  72. package/dist/streaming/TestGenerateStreamHandler.d.ts.map +1 -0
  73. package/dist/streaming/TestGenerateStreamHandler.js +321 -0
  74. package/dist/streaming/TestGenerateStreamHandler.js.map +1 -0
  75. package/dist/streaming/index.d.ts +16 -0
  76. package/dist/streaming/index.d.ts.map +1 -0
  77. package/dist/streaming/index.js +39 -0
  78. package/dist/streaming/index.js.map +1 -0
  79. package/dist/utils/Database.d.ts.map +1 -1
  80. package/dist/utils/Database.js +15 -1
  81. package/dist/utils/Database.js.map +1 -1
  82. package/dist/utils/__mocks__/Logger.d.ts +26 -0
  83. package/dist/utils/__mocks__/Logger.d.ts.map +1 -0
  84. package/dist/utils/__mocks__/Logger.js +42 -0
  85. package/dist/utils/__mocks__/Logger.js.map +1 -0
  86. package/package.json +19 -6
  87. package/dist/agents/mixins/NeuralCapableMixin.d.ts +0 -130
  88. package/dist/agents/mixins/NeuralCapableMixin.d.ts.map +0 -1
  89. package/dist/agents/mixins/NeuralCapableMixin.js +0 -358
  90. package/dist/agents/mixins/NeuralCapableMixin.js.map +0 -1
  91. package/dist/agents/mixins/QUICCapableMixin.d.ts +0 -34
  92. package/dist/agents/mixins/QUICCapableMixin.d.ts.map +0 -1
  93. package/dist/agents/mixins/QUICCapableMixin.js +0 -346
  94. package/dist/agents/mixins/QUICCapableMixin.js.map +0 -1
  95. package/dist/core/security/CertificateValidator.d.ts +0 -130
  96. package/dist/core/security/CertificateValidator.d.ts.map +0 -1
  97. package/dist/core/security/CertificateValidator.js +0 -376
  98. package/dist/core/security/CertificateValidator.js.map +0 -1
  99. package/dist/core/transport/QUICTransport.d.ts +0 -62
  100. package/dist/core/transport/QUICTransport.d.ts.map +0 -1
  101. package/dist/core/transport/QUICTransport.js +0 -381
  102. package/dist/core/transport/QUICTransport.js.map +0 -1
  103. package/dist/core/transport/SecureQUICTransport.d.ts +0 -71
  104. package/dist/core/transport/SecureQUICTransport.d.ts.map +0 -1
  105. package/dist/core/transport/SecureQUICTransport.js +0 -253
  106. package/dist/core/transport/SecureQUICTransport.js.map +0 -1
  107. package/dist/learning/AdvancedFeatureExtractor.d.ts +0 -123
  108. package/dist/learning/AdvancedFeatureExtractor.d.ts.map +0 -1
  109. package/dist/learning/AdvancedFeatureExtractor.js +0 -423
  110. package/dist/learning/AdvancedFeatureExtractor.js.map +0 -1
  111. package/dist/learning/NeuralPatternMatcher.d.ts +0 -184
  112. package/dist/learning/NeuralPatternMatcher.d.ts.map +0 -1
  113. package/dist/learning/NeuralPatternMatcher.js +0 -702
  114. package/dist/learning/NeuralPatternMatcher.js.map +0 -1
  115. package/dist/learning/NeuralTrainer.d.ts +0 -209
  116. package/dist/learning/NeuralTrainer.d.ts.map +0 -1
  117. package/dist/learning/NeuralTrainer.js +0 -478
  118. package/dist/learning/NeuralTrainer.js.map +0 -1
  119. package/dist/transport/QUICTransport.d.ts +0 -340
  120. package/dist/transport/QUICTransport.d.ts.map +0 -1
  121. package/dist/transport/QUICTransport.js +0 -814
  122. package/dist/transport/QUICTransport.js.map +0 -1
  123. package/dist/transport/UDPTransport.d.ts +0 -348
  124. package/dist/transport/UDPTransport.d.ts.map +0 -1
  125. package/dist/transport/UDPTransport.js +0 -820
  126. package/dist/transport/UDPTransport.js.map +0 -1
package/README.md CHANGED
@@ -7,379 +7,280 @@
7
7
  [![TypeScript](https://img.shields.io/badge/TypeScript-5.0+-blue.svg)](https://www.typescriptlang.org/)
8
8
  [![Node.js](https://img.shields.io/badge/Node.js-18+-green.svg)](https://nodejs.org/)
9
9
 
10
- **Version 1.3.2** - Security Hardening
10
+ **Version 1.3.4** | [Changelog](CHANGELOG.md) | [Issues](https://github.com/proffesor-for-testing/agentic-qe/issues) | [Discussions](https://github.com/proffesor-for-testing/agentic-qe/discussions)
11
11
 
12
- > Enterprise-grade test automation with AI learning, comprehensive skills library (35 QE skills), and optional 70-81% cost savings through intelligent model routing (opt-in feature).
12
+ > Enterprise-grade test automation with AI learning, comprehensive skills library (34 QE skills), and optional 70-81% cost savings through intelligent model routing.
13
13
 
14
- 🧠 **20% Continuous Improvement** | πŸ“š **35 World-Class QE Skills** | 🎯 **100% Flaky Test Detection** | πŸ’° **70-81% Cost Savings (opt-in)** | πŸ”’ **100% CodeQL Resolution**
15
-
16
- [Quick Start](#quick-start) β€’ [Documentation](docs/) β€’ [Contributing](CONTRIBUTING.md) β€’ [Examples](examples/)
14
+ 🧠 **20% Continuous Improvement** | πŸ“š **34 World-Class QE Skills** | 🎯 **100% Flaky Test Detection** | πŸ’° **70-81% Cost Savings** | πŸ”§ **61 MCP Tools**
17
15
 
18
16
  </div>
19
17
 
20
18
  ---
21
19
 
22
- ## πŸŽ‰ What's New in v1.3.2
23
-
24
- **πŸ” Security Release**: Fixed all 4 open CodeQL security alerts - achieving **100% alert resolution (26/26 fixed)**. Critical fixes include elimination of cryptographic randomness bias, enhanced prototype pollution prevention, and comprehensive security test coverage.
25
-
26
- ### Previous Release (v1.3.1)
27
-
28
- **Critical Bug Fix**: Fixed `aqe init` command that was using hardcoded versions (1.0.5, 1.1.0) instead of reading from `package.json`. All generated config files now correctly sync with the package version.
29
-
30
- ### Previous Release (v1.3.0)
31
-
32
- ### Security Hardening + Skills Expansion (Oct 23-24, 2025)
33
- **2 days of intensive development** | **Security hardening + 17 new skills** | **11,500+ lines of expert content**
34
-
35
- #### πŸŽ“ **60 Claude Skills Total (35 QE-Specific)**
36
-
37
- **Phase 1: Original Quality Engineering Skills (18 skills)** - World-class v1.0.0 ✨
38
- - agentic-quality-engineering, holistic-testing-pact, context-driven-testing, exploratory-testing-advanced
39
- - risk-based-testing, test-automation-strategy, api-testing-patterns, performance-testing, security-testing
40
- - tdd-london-chicago, xp-practices, code-review-quality, refactoring-patterns, quality-metrics
41
- - bug-reporting-excellence, technical-writing, consultancy-practices
20
+ ## ⚑ Quick Start
42
21
 
43
- **Phase 2: Expanded QE Skills Library (17 NEW skills)** - v1.0.0 πŸ†•
44
- - **Testing Methodologies (6)**: regression-testing, shift-left-testing, shift-right-testing, test-design-techniques, mutation-testing, test-data-management
45
- - **Specialized Testing (9)**: accessibility-testing, mobile-testing, database-testing, contract-testing, chaos-engineering-resilience, compatibility-testing, localization-testing, compliance-testing, visual-testing-advanced
46
- - **Testing Infrastructure (2)**: test-environment-management, test-reporting-analytics
22
+ ### Install & Initialize
47
23
 
48
- **Total QE Skills: 35 (95%+ coverage of modern QE practices)** πŸ†
49
-
50
- **Skill Optimization Achievements:**
51
- - βœ… 107 unique tags, 156 cross-references
52
- - βœ… Semantic versioning (v1.0.0)
53
- - βœ… 34x speedup with 13 parallel agents
54
- - βœ… Quality: 52% β†’ 100% (+48%)
55
-
56
- **Claude Flow Integration Skills (25 skills)**
57
- - AgentDB: advanced, learning, memory-patterns, optimization, vector-search (5)
58
- - GitHub: code-review, multi-repo, project-management, release-management, workflow-automation (5)
59
- - Flow Nexus: neural, platform, swarm (3)
60
- - Advanced: hive-mind-advanced, hooks-automation, pair-programming, performance-analysis, sparc-methodology, skill-builder, stream-chain, swarm-advanced, swarm-orchestration, reasoningbank-agentdb, reasoningbank-intelligence, verification-quality (12)
61
-
62
- **Unified CLAUDE.md** - 72 Total Agents (18 QE + 54 Claude Flow)
63
-
64
- #### πŸš€ **AgentDB Integration - Production Hardening**
65
-
66
- **Code Reduction: 2,290+ Lines Removed (95%)**
67
- - 900 lines: Custom QUIC β†’ AgentDB QUIC sync (<1ms latency, TLS 1.3)
68
- - 800 lines: Custom neural β†’ AgentDB learning plugins (9 RL algorithms)
69
- - 896 lines: Mixins removed (QUICCapableMixin, NeuralCapableMixin)
70
- - 590 lines: Wrapper removed (AgentDBIntegration)
71
-
72
- **Performance Improvements** ⚑
73
- - QUIC Latency: 6.23ms β†’ <1ms (84% faster)
74
- - Vector Search: 150ms β†’ 1ms (150x faster)
75
- - Neural Training: 1000ms β†’ 10-100ms (10-100x faster)
76
- - Memory Usage: 512MB β†’ 128-16MB (4-32x less)
77
- - Startup Time: 500ms β†’ 300ms (40% faster)
78
-
79
- **Security Enhancements** πŸ”’
80
- - OWASP Compliance: 70% β†’ 90%+ (+20 points)
81
- - Vulnerabilities Fixed: 8 total (3 CRITICAL, 5 HIGH)
82
- - TLS 1.3: Enforced by default
83
- - Certificate Validation: Mandatory
84
-
85
- #### ✨ **New Features**
86
-
87
- **Advanced Search & Indexing**
88
- - HNSW Indexing: 150x faster vector search (O(log n))
89
- - Quantization: 4-32x memory reduction
90
- - Vector Search: Semantic search across all memories
91
- - Full-Text Search: BM25 ranking
92
-
93
- **9 Reinforcement Learning Algorithms**
94
- - Decision Transformer, Q-Learning, SARSA, Actor-Critic
95
- - DQN, PPO, A3C, REINFORCE, Monte Carlo
96
-
97
- **QUIC Synchronization**
98
- - Sub-millisecond latency (<1ms)
99
- - TLS 1.3 encryption by default
100
- - Automatic connection recovery
101
- - Stream multiplexing
102
-
103
- #### πŸ§ͺ **Test Suite Expansion**
104
- - 60+ new test files added
105
- - AgentDB: 6/6 tests (100%)
106
- - Core: 53/53 tests (100%)
107
- - Total: 59/59 tests passing (100%)
108
- - Zero regressions detected
109
-
110
- #### 🧹 **Repository Cleanup**
111
- - Documentation: 24 reports archived (4.1MB saved)
112
- - Dependencies: 89 packages removed (7.3MB saved)
113
- - Total: 11.4MB savings
114
- - Clean build: Zero TypeScript errors
115
-
116
- #### πŸ’” **Breaking Changes**
117
- - `enableQUIC()` β†’ `initializeAgentDB({ quic: {...} })`
118
- - `enableNeural()` β†’ `initializeAgentDB({ learning: {...} })`
119
- - Removed: QUICTransport, NeuralPatternMatcher, mixins
120
- - See [Migration Guide](docs/AGENTDB-MIGRATION-GUIDE.md)
121
-
122
- **Release Score: 90/100** βœ… | [Complete Changelog](docs/COMPLETE-1.2.0-CHANGELOG.md)
24
+ ```bash
25
+ # Install globally
26
+ npm install -g agentic-qe
123
27
 
124
- ---
28
+ # Initialize your project
29
+ cd your-project
30
+ aqe init
125
31
 
126
- ## πŸŽ‰ What's in v1.1.0
32
+ # Add MCP server to Claude Code (optional)
33
+ claude mcp add agentic-qe npx -y agentic-qe mcp:start
127
34
 
128
- ### Intelligence Boost Release (Previous)
35
+ # Verify connection
36
+ claude mcp list
37
+ ```
129
38
 
130
- **Learning System** 🧠
131
- - Q-learning reinforcement learning for strategy optimization
132
- - 20% improvement target tracking with automatic achievement
133
- - Experience replay buffer (10,000 experiences)
134
- - Automatic strategy recommendation with 95%+ confidence
135
- - Cross-agent knowledge sharing
39
+ ### Use from Claude Code CLI
136
40
 
137
- **Pattern Bank** πŸ“¦
138
- - Cross-project pattern sharing and reuse
139
- - 85%+ matching accuracy with AI-powered similarity
140
- - 6 framework support (Jest, Mocha, Cypress, Vitest, Jasmine, AVA)
141
- - Automatic pattern extraction from existing tests
142
- - Pattern quality scoring and versioning
41
+ Ask Claude to use AQE agents directly from your terminal:
143
42
 
144
- **ML Flaky Detection** 🎯
145
- - 100% detection accuracy (target: 90%)
146
- - 0% false positive rate (target: < 5%)
147
- - Root cause analysis (timing, race conditions, dependencies, isolation)
148
- - Automated fix recommendations with code examples
149
- - < 1 second processing time for 1000+ test results
43
+ ```bash
44
+ # Generate comprehensive tests
45
+ claude "Use qe-test-generator to create tests for src/services/user-service.ts with 95% coverage"
150
46
 
151
- **Continuous Improvement** πŸ”„
152
- - A/B testing framework for strategy comparison
153
- - Auto-optimization with statistical confidence (95%+)
154
- - Failure pattern analysis and mitigation
155
- - Performance benchmarks (< 50ms pattern matching, < 100ms learning)
47
+ # Run quality pipeline
48
+ claude "Initialize AQE fleet: generate tests, execute them, analyze coverage, and run quality gate"
156
49
 
157
- **Enhanced Agents:**
158
- - **TestGeneratorAgent**: Pattern-based generation (20%+ faster)
159
- - **CoverageAnalyzerAgent**: Learning-enhanced analysis
160
- - **FlakyTestHunterAgent**: ML-based detection (99% accuracy)
50
+ # Detect flaky tests
51
+ claude "Use qe-flaky-test-hunter to analyze the last 100 test runs and identify flaky tests"
52
+ ```
161
53
 
162
- See [CHANGELOG.md](CHANGELOG.md) for full details.
54
+ **What gets initialized:**
55
+ - βœ… Multi-Model Router (70-81% cost savings - opt-in)
56
+ - βœ… Learning System (20% improvement target)
57
+ - βœ… Pattern Bank (cross-project reuse)
58
+ - βœ… ML Flaky Detection (100% accuracy)
59
+ - βœ… 18 Specialized agent definitions
60
+ - βœ… 8 AQE slash commands
61
+ - βœ… Configuration directory
163
62
 
164
63
  ---
165
64
 
166
- ## πŸš€ Features
65
+ ## ✨ Features
66
+
67
+ ### πŸ€– Autonomous Agent Fleet
68
+ - **18 Specialized Agents**: Expert agents for every QE domain (test generation, coverage analysis, security scanning, performance testing)
69
+ - **AI-Powered Coordination**: Event-driven architecture with intelligent task distribution
70
+ - **Zero External Dependencies**: Native AQE hooks system (100-500x faster than external coordination)
71
+ - **Scalable**: From single developer projects to enterprise-scale testing infrastructure
167
72
 
168
- ### Phase 1: Cost Optimization (v1.0.5)
73
+ ### 🧠 Intelligence & Learning (v1.1.0)
74
+ - **Q-Learning System**: 20% improvement target with automatic strategy optimization
75
+ - **Pattern Bank**: 85%+ matching accuracy across 6 test frameworks (Jest, Mocha, Cypress, Vitest, Jasmine, AVA)
76
+ - **ML Flaky Detection**: 100% accuracy with root cause analysis and automated fix recommendations
77
+ - **Continuous Improvement**: A/B testing framework with 95%+ statistical confidence
78
+ - **Experience Replay**: Learn from 10,000+ past executions
169
79
 
170
- #### πŸ’° Multi-Model Router
171
- - **70-81% Cost Savings**: Intelligent AI model selection saves $417+ per month
80
+ ### πŸ’° Cost Optimization (v1.0.5)
81
+ - **Multi-Model Router**: 70-81% cost savings through intelligent model selection (opt-in feature)
172
82
  - **4+ AI Models**: GPT-3.5, GPT-4, Claude Haiku, Claude Sonnet 4.5
173
- - **Smart Routing**: Automatic complexity analysis and model selection
174
- - **Real-Time Tracking**: Live cost monitoring with daily/monthly budgets
175
- - **Budget Alerts**: Email, Slack, and webhook notifications
176
- - **Cost Forecasting**: Predict future costs with 90% confidence
83
+ - **Smart Routing**: Automatic complexity analysis and optimal model selection
84
+ - **Real-Time Tracking**: Live cost monitoring with budget alerts and forecasting
177
85
  - **ROI Dashboard**: Track savings vs single-model baseline
178
86
 
179
- #### πŸ“Š Real-Time Streaming
180
- - **Live Progress Updates**: Real-time feedback for all operations
181
- - **Test Generation Streaming**: See tests as they're created
182
- - **Test Execution Streaming**: Live pass/fail updates
183
- - **Coverage Streaming**: Real-time gap detection
184
- - **Progress Bars**: Beautiful terminal progress visualization
185
- - **Cancellation Support**: Stop operations mid-stream
186
- - **Event Piping**: Chain multiple operations together
87
+ ### πŸ“Š Comprehensive Testing
88
+ - **Multi-Framework Support**: Jest, Mocha, Cypress, Playwright, Vitest, Jasmine, AVA
89
+ - **Parallel Execution**: 10,000+ concurrent tests with intelligent orchestration
90
+ - **Real-Time Coverage**: O(log n) algorithms for instant gap detection
91
+ - **Performance Testing**: k6, JMeter, Gatling integration
92
+ - **Real-Time Streaming**: Live progress updates for all operations
187
93
 
188
- ### Phase 2: Intelligence Boost (v1.1.0) πŸ†•
94
+ ### πŸŽ“ 34 QE Skills Library (v1.3.0)
95
+ **95%+ coverage of modern QE practices**
189
96
 
190
- #### 🧠 Learning System
191
- - **Q-Learning Algorithm**: Reinforcement learning for strategy optimization
192
- - **20% Improvement Target**: Automatic tracking and achievement
193
- - **Experience Replay**: Learn from 10,000+ past executions
194
- - **Strategy Recommendation**: AI-powered optimal strategy selection
195
- - **Cross-Agent Sharing**: Agents learn from each other's experiences
196
-
197
- #### πŸ“¦ Pattern Bank
198
- - **Pattern Extraction**: Automatic extraction from existing tests
199
- - **85%+ Matching Accuracy**: AI-powered pattern matching
200
- - **Cross-Project Sharing**: Export/import patterns across teams
201
- - **6 Framework Support**: Jest, Mocha, Cypress, Vitest, Jasmine, AVA
202
- - **Quality Scoring**: Automatic pattern quality assessment
203
-
204
- #### 🎯 ML Flaky Detection
205
- - **100% Accuracy**: ML-based detection with zero false positives
206
- - **Root Cause Analysis**: Identify timing, race conditions, dependencies
207
- - **Automated Fixes**: Generate fix recommendations with code examples
208
- - **Continuous Monitoring**: Track test reliability over time
209
- - **< 1 Second Processing**: 8,000+ test results per second
210
-
211
- #### πŸ”„ Continuous Improvement
212
- - **A/B Testing**: Compare strategies with statistical confidence
213
- - **Auto-Optimization**: Apply winning strategies automatically
214
- - **Failure Pattern Analysis**: Detect and mitigate recurring issues
215
- - **Performance Benchmarks**: < 50ms pattern matching, < 100ms learning
216
-
217
- ### Core Features
218
-
219
- #### πŸ€– Autonomous Agent Fleet
220
- - **18 Specialized Agents**: Each agent is an expert in specific quality engineering domains
221
- - _Note: 17 QE-specific agents + 1 general-purpose base-template-generator agent_
222
- - **AQE Hooks System**: 100-500x faster coordination with zero external dependencies
223
- - **Intelligent Coordination**: Event-driven architecture with automatic task distribution
224
- - **Scalable**: From single developer projects to enterprise-scale testing infrastructure
225
- - **Self-Organizing**: Agents autonomously coordinate testing strategies
226
- - **Type-Safe**: Full TypeScript type checking and IntelliSense support
97
+ <details>
98
+ <summary><b>View All Skills</b></summary>
227
99
 
228
- #### πŸ§ͺ Comprehensive Testing
229
- - **AI-Powered Test Generation**: Generate comprehensive test suites automatically
230
- - **Multi-Framework Support**: Jest, Mocha, Cypress, Playwright, Vitest, Jasmine, AVA
231
- - **Parallel Execution**: Execute thousands of tests concurrently with intelligent orchestration
232
- - **Real-Time Coverage Analysis**: O(log n) algorithms for instant coverage gap detection
100
+ **Phase 1: Original Quality Engineering Skills (17 skills)**
101
+ - **Core Testing**: agentic-quality-engineering, holistic-testing-pact, context-driven-testing, exploratory-testing-advanced
102
+ - **Methodologies**: tdd-london-chicago, xp-practices, risk-based-testing, test-automation-strategy
103
+ - **Techniques**: api-testing-patterns, performance-testing, security-testing
104
+ - **Code Quality**: code-review-quality, refactoring-patterns, quality-metrics
105
+ - **Communication**: bug-reporting-excellence, technical-writing, consultancy-practices
233
106
 
234
- #### 🎯 Quality Intelligence
235
- - **Smart Quality Gates**: ML-driven quality assessment with risk scoring
236
- - **Security Scanning**: SAST, DAST, dependency analysis, and container security
237
- - **Performance Testing**: Load testing with k6, JMeter, and Gatling integration
238
- - **Visual Regression**: AI-powered screenshot comparison and UI validation
107
+ **Phase 2: Expanded QE Skills Library (17 skills)**
108
+ - **Testing Methodologies (6)**: regression-testing, shift-left-testing, shift-right-testing, test-design-techniques, mutation-testing, test-data-management
109
+ - **Specialized Testing (9)**: accessibility-testing, mobile-testing, database-testing, contract-testing, chaos-engineering-resilience, compatibility-testing, localization-testing, compliance-testing, visual-testing-advanced
110
+ - **Testing Infrastructure (2)**: test-environment-management, test-reporting-analytics
239
111
 
240
- #### ⚑ Advanced Capabilities
241
- - **API Contract Validation**: Breaking change detection across versions
242
- - **Test Data Generation**: 10,000+ realistic records per second
243
- - **Production Intelligence**: Convert production incidents into test scenarios
244
- - **Chaos Engineering**: Controlled fault injection for resilience testing
112
+ </details>
245
113
 
246
114
  ---
247
115
 
248
- ## πŸ“¦ Prerequisites & Installation
116
+ ## πŸ’» Usage Examples
249
117
 
250
- ### Prerequisites
118
+ ### Example 1: Single Agent Execution
251
119
 
252
- #### Required
253
- - **Claude Code**: Install from [claude.ai/code](https://claude.ai/code)
254
- - **Node.js**: 18.0 or higher
255
- - **npm**: 8.0 or higher
120
+ Ask Claude to use a specific agent:
256
121
 
257
- #### Optional (Advanced Features)
258
- - **Claude Flow**: For optional MCP coordination features
259
- ```bash
260
- npm install -g @claude/flow
261
- # or
262
- npx claude-flow@alpha init --force
263
- ```
122
+ ```bash
123
+ claude "Use the qe-test-generator agent to create comprehensive tests for src/services/user-service.ts with 95% coverage"
124
+ ```
264
125
 
265
- **Note**: AQE hooks system requires NO external dependencies. All coordination features are built-in with TypeScript.
126
+ **What happens:**
127
+ 1. Claude Code spawns qe-test-generator via Task tool
128
+ 2. Agent analyzes the source file
129
+ 3. Generates tests with pattern matching (Phase 2 feature)
130
+ 4. Stores results in memory at `aqe/test-plan/generated`
266
131
 
267
- ### Installation Steps
132
+ **Output:**
133
+ ```
134
+ Generated 42 tests
135
+ Pattern hit rate: 67%
136
+ Time saved: 2.3s
137
+ Quality score: 96%
138
+ ```
268
139
 
269
- 1. **Install Claude Code** globally or in your workspace
140
+ ### Example 2: Multi-Agent Parallel Execution
270
141
 
271
- 2. **Install Agentic QE**
142
+ Coordinate multiple agents at once:
272
143
 
273
- **Global Installation** (Recommended)
274
- ```bash
275
- npm install -g agentic-qe
144
+ ```bash
145
+ claude "Initialize the AQE fleet:
146
+ 1. Use qe-test-generator to create tests for src/services/*.ts
147
+ 2. Use qe-test-executor to run all tests in parallel
148
+ 3. Use qe-coverage-analyzer to find gaps with sublinear algorithms
149
+ 4. Use qe-quality-gate to validate against 95% threshold"
150
+ ```
276
151
 
277
- # Verify installation
278
- aqe --version
279
- ```
152
+ **What happens:**
153
+ 1. Claude spawns 4 agents concurrently in a single message
154
+ 2. Agents coordinate through `aqe/*` memory namespace
155
+ 3. Pipeline: test generator β†’ executor β†’ analyzer β†’ gate
156
+ 4. Real-time streaming progress updates
280
157
 
281
- **Project Installation**
282
- ```bash
283
- npm install --save-dev agentic-qe
158
+ **Memory namespaces:**
159
+ - `aqe/test-plan/*` - Test planning and requirements
160
+ - `aqe/coverage/*` - Coverage analysis results
161
+ - `aqe/performance/*` - Performance test data
162
+ - `aqe/quality/*` - Quality metrics
284
163
 
285
- # Use with npx
286
- npx aqe init
287
- ```
164
+ ### Example 3: Using Agents with Skills
288
165
 
289
- 3. **Local Development**
290
- ```bash
291
- git clone https://github.com/proffesor-for-testing/agentic-qe.git
292
- cd agentic-qe
293
- npm install
294
- npm run build
295
- npm link
296
- ```
166
+ Agents automatically leverage skills:
297
167
 
298
- ### System Requirements
168
+ ```bash
169
+ claude "Use qe-test-generator with shift-left-testing and test-design-techniques skills to create tests before implementing the new payment feature"
170
+ ```
299
171
 
300
- - **Memory**: 2GB+ recommended for large test suites
301
- - **OS**: Linux, macOS, Windows (via WSL2)
302
- - **Agent Execution**: Via Claude Code's Task tool or MCP integration
172
+ **Available skills** (agents auto-select from 34):
173
+ - TDD, API testing, performance, security
174
+ - Accessibility, mobile, chaos engineering
175
+ - Regression, shift-left/right, compliance
303
176
 
304
- ---
177
+ ### Example 4: Full Quality Pipeline
305
178
 
306
- ## ⚑ Quick Start
179
+ End-to-end quality workflow:
180
+
181
+ ```bash
182
+ claude "Run the full AQE quality pipeline:
183
+ 1. qe-requirements-validator - validate requirements are testable
184
+ 2. qe-test-generator - generate comprehensive test suite
185
+ 3. qe-test-executor - run tests with parallel execution
186
+ 4. qe-coverage-analyzer - analyze gaps using O(log n) algorithms
187
+ 5. qe-flaky-test-hunter - detect flaky tests with 100% ML accuracy
188
+ 6. qe-security-scanner - run SAST/DAST scans
189
+ 7. qe-performance-tester - load test critical paths
190
+ 8. qe-quality-gate - validate all quality criteria met
191
+ 9. qe-deployment-readiness - assess deployment risk"
192
+ ```
307
193
 
308
- ### 1. Install & Setup MCP Integration
194
+ ### Example 5: Specialized Testing Scenarios
309
195
 
310
196
  ```bash
311
- # Install Agentic QE
312
- npm install -g agentic-qe
197
+ # API contract validation
198
+ claude "Use qe-api-contract-validator to check if the new API changes break any existing contracts"
313
199
 
314
- # Add MCP server to Claude Code
315
- claude mcp add agentic-qe npx -y agentic-qe mcp:start
200
+ # Visual regression testing
201
+ claude "Use qe-visual-tester to compare screenshots of the updated dashboard against baseline"
316
202
 
317
- # Verify connection
318
- claude mcp list
203
+ # Chaos engineering
204
+ claude "Use qe-chaos-engineer to inject random failures and validate system resilience"
205
+
206
+ # Flaky test detection with ML
207
+ claude "Use qe-flaky-test-hunter to analyze the last 100 test runs and identify flaky tests with ML-powered root cause analysis"
319
208
  ```
320
209
 
321
- ### 2. Initialize Your Project (v1.1.0)
210
+ ### Example 6: Fleet Coordination at Scale
322
211
 
323
212
  ```bash
324
- # Initialize with Phase 1 + Phase 2 features
325
- cd your-project
326
- aqe init
213
+ # Coordinate 50+ agents for large projects
214
+ claude "Use qe-fleet-commander to coordinate parallel testing across 8 microservices with 50 agents total"
327
215
  ```
328
216
 
329
- **What gets initialized:**
330
- - βœ… Multi-Model Router (70-81% cost savings)
331
- - βœ… Learning System (20% improvement target)
332
- - βœ… Pattern Bank (cross-project reuse)
333
- - βœ… ML Flaky Detection (100% accuracy)
334
- - βœ… Improvement Loop (A/B testing)
335
- - βœ… 17 Specialized QE agent definitions (+ 1 general-purpose agent)
336
- - βœ… 8 AQE slash commands
337
- - βœ… Configuration directory
217
+ ### MCP Integration Examples
338
218
 
339
- ### 3. Use from Claude Code CLI
219
+ You can also use agents through MCP tools:
340
220
 
341
221
  ```bash
342
- # Ask Claude to generate tests using AQE agents with patterns
343
- claude "Initialize AQE fleet and generate comprehensive tests for src/services/user-service.ts with 95% coverage using pattern matching"
222
+ # Check MCP connection
223
+ claude mcp list
224
+
225
+ # Direct MCP tool usage (in Claude Code)
226
+ # Generate tests
227
+ mcp__agentic_qe__test_generate({
228
+ type: "unit",
229
+ framework: "jest",
230
+ targetFile: "src/user-service.ts"
231
+ })
232
+
233
+ # Execute tests
234
+ mcp__agentic_qe__test_execute({
235
+ parallel: true,
236
+ coverage: true
237
+ })
238
+
239
+ # Analyze coverage
240
+ mcp__agentic_qe__coverage_analyze({
241
+ threshold: 95
242
+ })
344
243
  ```
345
244
 
346
- **Agent Execution Model:**
347
- - Agents are Claude Code agent definitions (markdown files in `.claude/agents/`)
348
- - Executed via Claude Code's Task tool OR MCP tools
349
- - MCP integration enables Claude to orchestrate QE agents directly
350
- - NOT standalone Node.js processes
245
+ ### CLI Direct Usage
246
+
247
+ ```bash
248
+ # Generate tests
249
+ aqe test src/services/user-service.ts
351
250
 
352
- πŸ“– **[Complete MCP Integration Guide](docs/guides/MCP-INTEGRATION.md)** - Detailed setup, examples, and use cases
251
+ # Analyze coverage
252
+ aqe coverage --threshold 95
353
253
 
354
- ---
254
+ # Run quality gate
255
+ aqe quality
355
256
 
356
- ## 🎯 Phase 2 Commands (v1.1.0)
257
+ # View fleet status
258
+ aqe status --verbose
357
259
 
358
- ### Learning System Commands 🧠
260
+ # Enable multi-model router (70-81% cost savings)
261
+ aqe routing enable
359
262
 
360
- ```bash
361
- # Enable learning for all agents
263
+ # Start learning system
362
264
  aqe learn enable --all
265
+ ```
363
266
 
364
- # View learning metrics
365
- aqe learn status
267
+ ### Advanced Patterns
366
268
 
367
- # View learning history
368
- aqe learn history --agent test-generator
269
+ #### Pattern 1: Continuous Learning
369
270
 
370
- # Manual training
371
- aqe learn train --agent test-generator
271
+ ```bash
272
+ # Agents learn from execution
273
+ claude "Use qe-test-generator with learning enabled to create tests, then analyze improvement over time"
372
274
 
373
- # Export learning data
374
- aqe learn export --agent test-generator --output learning-state.json
275
+ # Check learning metrics
276
+ aqe learn status --agent test-generator
375
277
  ```
376
278
 
377
- **Example Output** - `aqe learn status`:
279
+ **Example Output:**
378
280
  ```
379
281
  πŸ“Š LEARNING STATUS
380
282
 
381
283
  Agent: test-generator
382
- ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
383
284
  Status: ENABLED βœ…
384
285
  Total Experiences: 247
385
286
  Exploration Rate: 15.3%
@@ -393,30 +294,19 @@ Top Strategies:
393
294
  1. property-based (confidence: 92%, success: 95%)
394
295
  2. mutation-based (confidence: 85%, success: 88%)
395
296
  3. example-based (confidence: 78%, success: 82%)
396
-
397
- Recent Trend: β†— improving
398
297
  ```
399
298
 
400
- ### Pattern Management Commands πŸ“¦
299
+ #### Pattern 2: Pattern Bank Usage
401
300
 
402
301
  ```bash
403
- # List all patterns
404
- aqe patterns list
405
-
406
- # Search patterns by keyword
407
- aqe patterns search "null check"
408
-
409
- # Extract patterns from tests
410
- aqe patterns extract --path tests/ --framework jest
302
+ # Extract and reuse patterns
303
+ claude "Use qe-test-generator to extract test patterns from existing tests, then apply them to new modules"
411
304
 
412
- # Share patterns across projects
413
- aqe patterns share --id pattern-001 --projects proj-a,proj-b
414
-
415
- # Export patterns
416
- aqe patterns export --output patterns-backup.json
305
+ # List patterns
306
+ aqe patterns list --framework jest
417
307
  ```
418
308
 
419
- **Example Output** - `aqe patterns list`:
309
+ **Example Output:**
420
310
  ```
421
311
  πŸ“¦ PATTERN LIBRARY (247 patterns)
422
312
 
@@ -425,67 +315,23 @@ ID | Name | Framework | Quality | Uses
425
315
  pattern-001| Null Parameter Check | jest | 92% | 142
426
316
  pattern-002| Empty Array Handling | jest | 89% | 98
427
317
  pattern-003| API Timeout Test | cypress | 95% | 87
428
- pattern-004| Database Transaction | mocha | 88% | 76
429
- pattern-005| Async Error Handling | jest | 91% | 65
430
-
431
- Total: 247 patterns | Average Quality: 87%
432
318
  ```
433
319
 
434
- ### Improvement Loop Commands πŸ”„
435
-
436
- ```bash
437
- # View improvement status
438
- aqe improve status
439
-
440
- # Start improvement loop
441
- aqe improve start
442
-
443
- # Run A/B test
444
- aqe improve ab-test --strategies "property-based,mutation-based" --sample-size 50
445
-
446
- # View failure patterns
447
- aqe improve failures
448
-
449
- # Generate improvement report
450
- aqe improve report --format html --output improvement-report.html
451
- ```
452
-
453
- ---
454
-
455
- ## 🎯 Phase 1 Commands (v1.0.5)
456
-
457
- ### Multi-Model Router Commands πŸ’°
320
+ #### Pattern 3: Cost Optimization
458
321
 
459
322
  ```bash
460
- # Enable cost-optimized routing (70-81% savings)
323
+ # Enable intelligent model routing
461
324
  aqe routing enable
462
325
 
463
- # View current configuration and savings
464
- aqe routing status
465
-
466
- # Launch real-time cost dashboard
326
+ # View savings
327
+ claude "Check routing status and show cost savings"
467
328
  aqe routing dashboard
468
-
469
- # Generate detailed cost report
470
- aqe routing report --format html --output report.html
471
-
472
- # View routing statistics
473
- aqe routing stats --days 30
474
-
475
- # Disable routing
476
- aqe routing disable
477
329
  ```
478
330
 
479
- **Example Output** - `aqe routing status`:
331
+ **Example Output:**
480
332
  ```
481
333
  βœ… Multi-Model Router Status
482
334
 
483
- Configuration:
484
- Status: ENABLED βœ“
485
- Default Model: claude-sonnet-4.5
486
- Cost Tracking: ENABLED βœ“
487
- Fallback Chains: ENABLED βœ“
488
-
489
335
  Cost Summary (Last 30 Days):
490
336
  Total Cost: $127.50
491
337
  Baseline Cost: $545.00
@@ -499,257 +345,20 @@ Model Usage:
499
345
  └─ gpt-4: 7% (critical tasks)
500
346
  ```
501
347
 
502
- πŸ“š **[Complete Routing Examples](docs/examples/ROUTING-EXAMPLES.md)** - CLI and programmatic usage
503
-
504
- ### Basic Commands
505
-
506
- ```bash
507
- # Check fleet status
508
- aqe status
509
-
510
- # Generate tests for a module
511
- aqe test src/services/user-service.ts
512
-
513
- # Analyze test coverage
514
- aqe coverage --threshold 95
515
-
516
- # Run quality gate validation
517
- aqe quality
518
-
519
- # Execute comprehensive test suite
520
- aqe execute --parallel --coverage
521
-
522
- # View all commands
523
- aqe help
524
- ```
525
-
526
- ---
527
-
528
- ## πŸ’» Programmatic Usage
529
-
530
- ### Pattern-Based Test Generation (v1.1.0) πŸ†•
531
-
532
- ```typescript
533
- import { TestGeneratorAgent, QEReasoningBank } from 'agentic-qe';
534
-
535
- // Initialize pattern bank
536
- const bank = new QEReasoningBank();
537
-
538
- // Create agent with pattern matching
539
- const agent = new TestGeneratorAgent(
540
- { agentId: 'test-gen-1', memoryStore },
541
- {
542
- targetCoverage: 95,
543
- framework: 'jest',
544
- enablePatterns: true, // βœ… Enable pattern matching
545
- enableLearning: true, // βœ… Enable learning
546
- reasoningBank: bank
547
- }
548
- );
549
-
550
- // Generate tests with patterns
551
- const result = await agent.execute({
552
- type: 'test-generation',
553
- payload: {
554
- sourceFile: 'src/myModule.ts',
555
- framework: 'jest'
556
- }
557
- });
558
-
559
- console.log(`Generated ${result.testsGenerated} tests`);
560
- console.log(`Pattern hit rate: ${result.patternHitRate}%`);
561
- console.log(`Time saved: ${result.patterns.savings}ms`);
562
- console.log(`Quality score: ${result.qualityScore}%`);
563
- ```
564
-
565
- **Performance Impact:**
566
- ```
567
- Without Patterns:
568
- β”œβ”€ Test Generation: 180ms avg
569
- β”œβ”€ Coverage: 78%
570
- └─ Quality Score: 82%
571
-
572
- With Patterns:
573
- β”œβ”€ Test Generation: 145ms avg (↓ 19.4%)
574
- β”œβ”€ Coverage: 94% (↑ 20.5%)
575
- └─ Quality Score: 96% (↑ 17.1%)
576
- ```
577
-
578
- ### Learning-Enhanced Coverage Analysis (v1.1.0) πŸ†•
579
-
580
- ```typescript
581
- import { CoverageAnalyzerAgent, LearningEngine } from 'agentic-qe';
582
-
583
- // Create learning engine
584
- const learningEngine = new LearningEngine('coverage-1', memory, {
585
- enabled: true,
586
- learningRate: 0.1,
587
- targetImprovement: 0.20 // 20% improvement target
588
- });
589
-
590
- await learningEngine.initialize();
591
-
592
- // Create agent with learning
593
- const agent = new CoverageAnalyzerAgent(
594
- { agentId: 'coverage-1', memoryStore: memory },
595
- {
596
- targetCoverage: 95,
597
- algorithm: 'sublinear',
598
- enableLearning: true // βœ… Enable learning
599
- }
600
- );
601
-
602
- // Analyze coverage (learning happens automatically)
603
- const analysis = await agent.execute({
604
- type: 'coverage-analysis',
605
- payload: {
606
- coverageReport: './coverage/coverage-final.json',
607
- threshold: 95
608
- }
609
- });
610
-
611
- // Check learning progress
612
- const status = await learningEngine.calculateImprovement();
613
- console.log(`Current improvement: ${(status.improvementRate * 100).toFixed(1)}%`);
614
- console.log(`Target reached: ${status.targetAchieved ? 'βœ… YES' : '❌ NO'}`);
615
- console.log(`Confidence: ${(status.confidence * 100).toFixed(1)}%`);
616
- ```
617
-
618
- ### ML Flaky Detection (v1.1.0) πŸ†•
619
-
620
- ```typescript
621
- import { FlakyTestHunterAgent, FlakyTestDetector } from 'agentic-qe';
622
-
623
- // Create detector with ML
624
- const detector = new FlakyTestDetector({
625
- minRuns: 5,
626
- passRateThreshold: 0.8,
627
- confidenceThreshold: 0.7,
628
- enableML: true // βœ… 100% accuracy
629
- });
630
-
631
- // Create agent
632
- const agent = new FlakyTestHunterAgent(
633
- { agentId: 'flaky-1', memoryStore: memory },
634
- {
635
- enableML: true, // βœ… 100% accuracy
636
- detector
637
- }
638
- );
639
-
640
- // Detect flaky tests
641
- const result = await agent.execute({
642
- type: 'flaky-detection',
643
- payload: {
644
- testHistory: testResults
645
- }
646
- });
647
-
648
- result.flakyTests.forEach(test => {
649
- console.log(`πŸ”΄ ${test.testName}`);
650
- console.log(` Pass Rate: ${(test.passRate * 100).toFixed(1)}%`);
651
- console.log(` Root Cause: ${test.rootCause.cause}`);
652
- console.log(` ML Confidence: ${(test.rootCause.mlConfidence * 100).toFixed(1)}%`);
653
- console.log(` Severity: ${test.severity}`);
654
- console.log(` Fix: ${test.fixRecommendations[0].recommendation}`);
655
- console.log(` Code Example:`);
656
- console.log(` ${test.fixRecommendations[0].codeExample}`);
657
- });
658
- ```
659
-
660
- **Detection Results:**
661
- ```
662
- Model Training Complete:
663
- Accuracy: 100.00% βœ… Exceeds 90% target by 10%
664
- Precision: 100.00% βœ… Perfect precision
665
- Recall: 100.00% βœ… Perfect recall
666
- F1 Score: 100.00% βœ… Perfect F1
667
- False Positive Rate: 0.00% βœ… Well below 5% target
668
-
669
- Processing 1,200 test results: ~150ms
670
- Throughput: ~8,000 results/second
671
- Memory Usage: < 5MB delta
672
- ```
673
-
674
- ### With Multi-Model Router (v1.0.5)
675
-
676
- ```typescript
677
- import { FleetManager, AdaptiveModelRouter } from 'agentic-qe';
678
-
679
- // Initialize fleet with cost-optimized routing
680
- const fleet = new FleetManager({
681
- maxAgents: 20,
682
- topology: 'mesh',
683
- routing: {
684
- enabled: true,
685
- defaultModel: 'claude-sonnet-4.5',
686
- enableCostTracking: true,
687
- enableFallback: true,
688
- modelPreferences: {
689
- simple: 'gpt-3.5-turbo', // 70% cheaper for simple tasks
690
- medium: 'claude-haiku', // 60% cheaper for standard tests
691
- complex: 'claude-sonnet-4.5', // Best quality/cost for complex
692
- critical: 'gpt-4' // Maximum quality when needed
693
- },
694
- budgets: {
695
- daily: 50,
696
- monthly: 1000
697
- }
698
- }
699
- });
700
-
701
- await fleet.initialize();
702
-
703
- // Spawn agent (automatically uses optimal model based on task complexity)
704
- const testGen = await fleet.spawnAgent('test-generator', {
705
- targetCoverage: 95,
706
- framework: 'jest',
707
- useRouting: true // Enable intelligent model selection
708
- });
709
-
710
- // Execute task (router selects cheapest model that meets quality requirements)
711
- const tests = await testGen.execute({
712
- sourceFile: 'src/services/user-service.ts',
713
- testStyle: 'property-based'
714
- });
715
-
716
- // Check cost savings
717
- const savings = await fleet.getRoutingSavings();
718
- console.log(`πŸ’° Total savings: $${savings.total} (${savings.percent}%)`);
719
- console.log(`πŸ“Š Models used: ${JSON.stringify(savings.modelBreakdown, null, 2)}`);
720
- ```
348
+ ### Pro Tips
721
349
 
722
- πŸ“š **[Complete Routing Examples](docs/examples/ROUTING-EXAMPLES.md)** - Advanced programmatic usage
723
-
724
- ---
725
-
726
- ## πŸ“Š Performance Benchmarks
727
-
728
- | Feature | Target | Actual | Status |
729
- |---------|--------|--------|--------|
730
- | **Pattern Matching (p95)** | <50ms | 32ms | βœ… Exceeded |
731
- | **Learning Iteration** | <100ms | 68ms | βœ… Exceeded |
732
- | **ML Flaky Detection (1000 tests)** | <500ms | 385ms | βœ… Exceeded |
733
- | **Agent Memory** | <100MB | 85MB | βœ… Exceeded |
734
- | **Cost Savings** | 70%+ | 70-81% | βœ… Achieved |
735
- | **Test Improvement** | 20%+ | 23%+ | βœ… Exceeded |
736
- | **Flaky Detection Accuracy** | 90%+ | 100% | βœ… Exceeded |
737
- | **False Positive Rate** | <5% | 0% | βœ… Exceeded |
738
-
739
- ### Core Performance
740
-
741
- - **Test Generation**: 1000+ tests/minute
742
- - **Parallel Execution**: 10,000+ concurrent tests
743
- - **Coverage Analysis**: O(log n) complexity
744
- - **Data Generation**: 10,000+ records/second
745
- - **Agent Spawning**: <100ms per agent
746
- - **Memory Efficient**: <2GB for typical projects
350
+ 1. **Batch agent operations**: Always spawn multiple agents in one Claude message for parallel execution
351
+ 2. **Use memory namespace**: Agents coordinate through `aqe/*` memory keys
352
+ 3. **Enable learning**: Add `--enable-learning` to agent commands for continuous improvement
353
+ 4. **Check agent status**: Use `aqe status` to see active agents and coordination
354
+ 5. **Review agent output**: Agents store detailed results in `.agentic-qe/logs/`
747
355
 
748
356
  ---
749
357
 
750
358
  ## πŸ€– Agent Types
751
359
 
752
- ### Core Testing Agents
360
+ <details>
361
+ <summary><b>Core Testing Agents (5 agents)</b></summary>
753
362
 
754
363
  | Agent | Purpose | Key Features | Phase 2 Enhancements |
755
364
  |-------|---------|-------------|---------------------|
@@ -759,14 +368,20 @@ console.log(`πŸ“Š Models used: ${JSON.stringify(savings.modelBreakdown, null, 2)
759
368
  | **quality-gate** | Intelligent validation | ML-driven decisions, risk assessment | βœ… Flaky test metrics |
760
369
  | **quality-analyzer** | Metrics analysis | ESLint, SonarQube, Lighthouse integration | - |
761
370
 
762
- ### Performance & Security
371
+ </details>
372
+
373
+ <details>
374
+ <summary><b>Performance & Security (2 agents)</b></summary>
763
375
 
764
376
  | Agent | Purpose | Key Features |
765
377
  |-------|---------|-------------|
766
378
  | **performance-tester** | Load & stress testing | k6, JMeter, Gatling, bottleneck detection |
767
379
  | **security-scanner** | Vulnerability detection | SAST, DAST, dependency scanning |
768
380
 
769
- ### Strategic Planning
381
+ </details>
382
+
383
+ <details>
384
+ <summary><b>Strategic Planning (3 agents)</b></summary>
770
385
 
771
386
  | Agent | Purpose | Key Features |
772
387
  |-------|---------|-------------|
@@ -774,7 +389,10 @@ console.log(`πŸ“Š Models used: ${JSON.stringify(savings.modelBreakdown, null, 2)
774
389
  | **production-intelligence** | Incident replay | RUM analysis, anomaly detection |
775
390
  | **fleet-commander** | Hierarchical coordination | 50+ agent orchestration |
776
391
 
777
- ### Advanced Testing
392
+ </details>
393
+
394
+ <details>
395
+ <summary><b>Advanced Testing (4 agents)</b></summary>
778
396
 
779
397
  | Agent | Purpose | Key Features | Phase 2 Enhancements |
780
398
  |-------|---------|-------------|---------------------|
@@ -783,7 +401,10 @@ console.log(`πŸ“Š Models used: ${JSON.stringify(savings.modelBreakdown, null, 2)
783
401
  | **api-contract-validator** | Breaking change detection | OpenAPI, GraphQL, gRPC | - |
784
402
  | **flaky-test-hunter** | Stability analysis | Statistical detection, auto-fix | βœ… 100% accuracy ML detection |
785
403
 
786
- ### Specialized
404
+ </details>
405
+
406
+ <details>
407
+ <summary><b>Specialized (3 agents)</b></summary>
787
408
 
788
409
  | Agent | Purpose | Key Features |
789
410
  |-------|---------|-------------|
@@ -791,386 +412,113 @@ console.log(`πŸ“Š Models used: ${JSON.stringify(savings.modelBreakdown, null, 2)
791
412
  | **visual-tester** | UI regression | AI-powered comparison |
792
413
  | **chaos-engineer** | Resilience testing | Fault injection, blast radius |
793
414
 
794
- ---
795
-
796
- ## πŸ—οΈ Architecture
797
-
798
- ### Core Components
799
-
800
- ```
801
- β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
802
- β”‚ Fleet Manager β”‚
803
- β”‚ (Central Coordination & Task Distribution) β”‚
804
- β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
805
- β”‚
806
- β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
807
- β”‚ β”‚ β”‚
808
- β”Œβ”€β”€β”€β”€β–Όβ”€β”€β”€β”€β” β”Œβ”€β”€β”€β–Όβ”€β”€β”€β”€β” β”Œβ”€β”€β”€β–Όβ”€β”€β”€β”€β”
809
- β”‚ Agent 1 β”‚ β”‚ Agent 2β”‚ β”‚ Agent Nβ”‚
810
- β”‚ Pool β”‚ β”‚ Pool β”‚ β”‚ Pool β”‚
811
- β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”¬β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”¬β”€β”€β”€β”€β”˜
812
- β”‚ β”‚ β”‚
813
- β”Œβ”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”
814
- β”‚ Event Bus β”‚
815
- β”‚ (Event-Driven Communication) β”‚
816
- β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”˜
817
- β”‚ β”‚
818
- β”Œβ”€β”€β”€β”€β–Όβ”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”
819
- β”‚ Memory β”‚ β”‚Database β”‚
820
- β”‚ Store β”‚ β”‚(SQLite) β”‚
821
- β”‚ β”‚ β”‚ β”‚
822
- β”‚ Phase 2:β”‚ β”‚ β”‚
823
- β”‚ Learningβ”‚ β”‚ β”‚
824
- β”‚ Patternsβ”‚ β”‚ β”‚
825
- β”‚ ML Modelβ”‚ β”‚ β”‚
826
- β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
827
- ```
828
-
829
- ### Event-Driven Architecture
415
+ </details>
830
416
 
831
- - **EventBus**: Real-time communication between agents
832
- - **Task Queue**: Priority-based task scheduling
833
- - **Memory Store**: Shared context and learning (SwarmMemoryManager)
834
- - **Persistence**: SQLite for state, metrics, and audit trails
417
+ <details>
418
+ <summary><b>General Purpose (1 agent)</b></summary>
835
419
 
836
- ### AQE Hooks System
837
-
838
- **Zero Dependencies** - Built-in TypeScript hooks for agent coordination:
839
-
840
- ```typescript
841
- // Automatic lifecycle hooks in every agent (aqe-hooks protocol)
842
- class QEAgent extends BaseAgent {
843
- protected async onPreTask(data): Promise<void> { /* prepare */ }
844
- protected async onPostTask(data): Promise<void> { /* validate */ }
845
- protected async onTaskError(data): Promise<void> { /* recover */ }
846
- }
847
-
848
- // Advanced verification hooks
849
- const hookManager = new VerificationHookManager(memoryStore);
850
- await hookManager.executePreTaskVerification({ task, context });
851
- await hookManager.executePostTaskValidation({ task, result });
852
- ```
420
+ | Agent | Purpose | Key Features |
421
+ |-------|---------|-------------|
422
+ | **base-template-generator** | Agent templates | General-purpose agent creation |
853
423
 
854
- **Performance**: 100-500x faster than external hooks (<1ms vs 100-500ms)
424
+ </details>
855
425
 
856
- **Features**:
857
- - Full TypeScript type safety
858
- - Direct SwarmMemoryManager integration
859
- - Built-in RollbackManager support
860
- - EventBus coordination
861
- - Context engineering (pre/post tool-use bundles)
426
+ **Total: 18 Agents** (17 QE-specific + 1 general-purpose)
862
427
 
863
428
  ---
864
429
 
865
430
  ## πŸ“– Documentation
866
431
 
867
- ### πŸ†• Phase 2 Features (v1.1.0)
868
- - [Learning System User Guide](docs/guides/LEARNING-SYSTEM-USER-GUIDE.md) - **NEW!** Q-learning and continuous improvement
869
- - [Pattern Management User Guide](docs/guides/PATTERN-MANAGEMENT-USER-GUIDE.md) - **NEW!** Cross-project pattern sharing
870
- - [ML Flaky Detection Guide](docs/guides/ML-FLAKY-DETECTION-USER-GUIDE.md) - **NEW!** 100% accurate flaky detection
871
- - [Performance Improvement Guide](docs/guides/PERFORMANCE-IMPROVEMENT-USER-GUIDE.md) - **NEW!** A/B testing and optimization
872
- - [Learning System Examples](docs/examples/LEARNING-SYSTEM-EXAMPLES.md) - **NEW!** Learning code examples
873
- - [Pattern Examples](docs/examples/REASONING-BANK-EXAMPLES.md) - **NEW!** Pattern usage examples
874
- - [Flaky Detection Examples](docs/examples/FLAKY-DETECTION-ML-EXAMPLES.md) - **NEW!** ML detection examples
875
-
876
- ### Phase 1 Features (v1.0.5)
877
- - [Multi-Model Router Guide](docs/guides/MULTI-MODEL-ROUTER.md) - Save 70% on AI costs
878
- - [Streaming API Tutorial](docs/guides/STREAMING-API.md) - Real-time progress updates
879
- - [Cost Optimization Best Practices](docs/guides/COST-OPTIMIZATION.md) - Maximize ROI
880
- - [Migration Guide v1.0.5](docs/guides/MIGRATION-V1.0.5.md) - Upgrade guide
881
- - [Routing API Reference](docs/api/ROUTING-API.md) - Complete API docs
882
- - [Streaming API Reference](docs/api/STREAMING-API.md) - Complete API docs
883
- - [Phase 1 Code Examples](docs/examples/ROUTING-EXAMPLES.md) - Working examples
884
-
885
432
  ### Getting Started
886
- - [Quick Start Guide](docs/AQE-CLI.md)
433
+ - [Quick Start Guide](docs/AQE-CLI.md) - Get started in 5 minutes
887
434
  - [User Guide](docs/USER-GUIDE.md) - Comprehensive workflows and examples
888
- - [Agent Types Overview](docs/Agentic-QE-Fleet-Specification.md)
435
+ - [MCP Integration](docs/guides/MCP-INTEGRATION.md) - Claude Code integration
889
436
  - [Configuration Guide](docs/CONFIGURATION.md) - Complete configuration reference
890
437
  - [Troubleshooting Guide](docs/TROUBLESHOOTING.md) - Common issues and solutions
891
438
 
892
- ### User Guides
893
- - [Test Generation](docs/guides/TEST-GENERATION.md)
894
- - [Coverage Analysis](docs/guides/COVERAGE-ANALYSIS.md)
895
- - [Quality Gates](docs/guides/QUALITY-GATES.md)
896
- - [Performance Testing](docs/guides/PERFORMANCE-TESTING.md)
897
- - [Test Execution](docs/guides/TEST-EXECUTION.md)
898
- - [MCP Integration](docs/guides/MCP-INTEGRATION.md)
899
-
900
- ### Advanced Topics
901
- - [API Reference](docs/API.md)
902
- - [Agent Development](docs/AGENT-DEVELOPMENT.md)
903
- - [MCP Integration](docs/CLAUDE-MD-INTEGRATION.md)
904
- - [Best Practices](docs/AI%20%26%20Agentic%20Security%20Best%20Practices.md)
905
- - [AQE Hooks Guide](docs/AQE-HOOKS-GUIDE.md)
906
-
907
- ### Commands Reference
908
- - [AQE Commands Overview](docs/QE-COMMANDS-INDEX.md)
909
- - [Command Specifications](docs/QE-SLASH-COMMANDS-SPECIFICATION.md)
910
- - [Hooks Architecture](docs/QE_HOOKS_ARCHITECTURE.md)
439
+ ### Feature Guides
911
440
 
912
- ---
441
+ **Phase 2 Features (v1.1.0)**
442
+ - [Learning System User Guide](docs/guides/LEARNING-SYSTEM-USER-GUIDE.md) - Q-learning and continuous improvement
443
+ - [Pattern Management User Guide](docs/guides/PATTERN-MANAGEMENT-USER-GUIDE.md) - Cross-project pattern sharing
444
+ - [ML Flaky Detection Guide](docs/guides/ML-FLAKY-DETECTION-USER-GUIDE.md) - 100% accurate flaky detection
445
+ - [Performance Improvement Guide](docs/guides/PERFORMANCE-IMPROVEMENT-USER-GUIDE.md) - A/B testing and optimization
913
446
 
914
- ## πŸ”§ Configuration
447
+ **Phase 1 Features (v1.0.5)**
448
+ - [Multi-Model Router Guide](docs/guides/MULTI-MODEL-ROUTER.md) - Save 70% on AI costs
449
+ - [Streaming API Tutorial](docs/guides/STREAMING-API.md) - Real-time progress updates
450
+ - [Cost Optimization Best Practices](docs/guides/COST-OPTIMIZATION.md) - Maximize ROI
915
451
 
916
- ### Environment Variables
452
+ ### Testing Guides
453
+ - [Test Generation](docs/guides/TEST-GENERATION.md) - AI-powered test creation
454
+ - [Coverage Analysis](docs/guides/COVERAGE-ANALYSIS.md) - O(log n) gap detection
455
+ - [Quality Gates](docs/guides/QUALITY-GATES.md) - Intelligent validation
456
+ - [Performance Testing](docs/guides/PERFORMANCE-TESTING.md) - Load and stress testing
457
+ - [Test Execution](docs/guides/TEST-EXECUTION.md) - Parallel orchestration
917
458
 
918
- Create a `.env` file in your project root:
459
+ ### Advanced Topics
460
+ - [API Reference](docs/API.md) - Complete API documentation
461
+ - [Agent Development](docs/AGENT-DEVELOPMENT.md) - Create custom agents
462
+ - [Agent Types Overview](docs/Agentic-QE-Fleet-Specification.md) - Complete agent reference
463
+ - [AQE Hooks Guide](docs/AQE-HOOKS-GUIDE.md) - Native coordination system
464
+ - [Best Practices](docs/AI%20%26%20Agentic%20Security%20Best%20Practices.md) - Security and quality
919
465
 
920
- ```bash
921
- # Fleet Configuration
922
- FLEET_ID=my-project-fleet
923
- MAX_AGENTS=20
924
- HEARTBEAT_INTERVAL=30000
925
-
926
- # Phase 2: Learning System
927
- LEARNING_ENABLED=true
928
- LEARNING_RATE=0.1
929
- TARGET_IMPROVEMENT=0.20
930
-
931
- # Phase 2: Pattern Bank
932
- PATTERN_MATCHING_ENABLED=true
933
- MIN_PATTERN_QUALITY=0.8
934
-
935
- # Phase 2: ML Flaky Detection
936
- FLAKY_DETECTION_ML=true
937
- FLAKY_MIN_RUNS=5
938
-
939
- # Database
940
- DB_TYPE=sqlite
941
- DB_FILENAME=./data/fleet.db
942
-
943
- # Logging
944
- LOG_LEVEL=info
945
- LOG_FORMAT=json
946
-
947
- # API (optional)
948
- API_PORT=3000
949
- API_HOST=localhost
950
- ```
466
+ ### Commands Reference
467
+ - [AQE Commands Overview](docs/QE-COMMANDS-INDEX.md) - All CLI commands
468
+ - [Command Specifications](docs/QE-SLASH-COMMANDS-SPECIFICATION.md) - Slash command reference
469
+ - [Hooks Architecture](docs/QE_HOOKS_ARCHITECTURE.md) - Coordination architecture
951
470
 
952
- ### Fleet Configuration
953
-
954
- Create `config/fleet.yaml`:
955
-
956
- ```yaml
957
- fleet:
958
- id: "my-project-fleet"
959
- name: "My Project QE Fleet"
960
- maxAgents: 20
961
- topology: mesh
962
-
963
- agents:
964
- test-generator:
965
- count: 3
966
- config:
967
- frameworks: [jest, cypress, playwright]
968
- targetCoverage: 95
969
- enablePatterns: true # Phase 2: Pattern matching
970
- enableLearning: true # Phase 2: Learning
971
-
972
- coverage-analyzer:
973
- count: 2
974
- config:
975
- targetCoverage: 95
976
- optimizationAlgorithm: sublinear
977
- enableLearning: true # Phase 2: Learning
978
-
979
- flaky-test-hunter:
980
- count: 1
981
- config:
982
- enableML: true # Phase 2: ML detection
983
- minRuns: 5
984
- passRateThreshold: 0.8
985
-
986
- quality-analyzer:
987
- count: 2
988
- config:
989
- tools: [eslint, sonarqube, lighthouse]
990
- thresholds:
991
- coverage: 80
992
- complexity: 10
993
- maintainability: 65
994
-
995
- # Phase 2: Learning Configuration
996
- learning:
997
- enabled: true
998
- learningRate: 0.1
999
- discountFactor: 0.95
1000
- explorationRate: 0.3
1001
- targetImprovement: 0.20
1002
-
1003
- # Phase 2: Pattern Bank Configuration
1004
- patterns:
1005
- enabled: true
1006
- minQuality: 0.8
1007
- frameworks: [jest, mocha, cypress, vitest, jasmine, ava]
1008
- autoExtract: true
1009
-
1010
- # Phase 2: Flaky Detection Configuration
1011
- flakyDetection:
1012
- enableML: true
1013
- minRuns: 5
1014
- passRateThreshold: 0.8
1015
- confidenceThreshold: 0.7
1016
- ```
471
+ ### Code Examples
472
+ - [Learning System Examples](docs/examples/LEARNING-SYSTEM-EXAMPLES.md) - Learning code examples
473
+ - [Pattern Examples](docs/examples/REASONING-BANK-EXAMPLES.md) - Pattern usage examples
474
+ - [Flaky Detection Examples](docs/examples/FLAKY-DETECTION-ML-EXAMPLES.md) - ML detection examples
475
+ - [Routing Examples](docs/examples/ROUTING-EXAMPLES.md) - Cost optimization examples
1017
476
 
1018
477
  ---
1019
478
 
1020
- ## πŸ§ͺ Examples
1021
-
1022
- ### Example 1: Pattern-Based Test Generation
1023
-
1024
- ```typescript
1025
- import { QEReasoningBank, PatternExtractor, TestGeneratorAgent } from 'agentic-qe';
1026
-
1027
- // Initialize components
1028
- const bank = new QEReasoningBank();
1029
- const extractor = new PatternExtractor({ minQuality: 0.8 });
1030
-
1031
- // Extract patterns from existing tests
1032
- const patterns = await extractor.extractFromDirectory('./tests', {
1033
- recursive: true,
1034
- filePattern: '**/*.test.ts'
1035
- });
1036
-
1037
- console.log(`Extracted ${patterns.length} patterns`);
1038
-
1039
- // Store patterns in bank
1040
- for (const pattern of patterns) {
1041
- await bank.storePattern(pattern);
1042
- }
1043
-
1044
- // Use patterns in test generation
1045
- const testGen = new TestGeneratorAgent(
1046
- { agentId: 'test-gen-1', memoryStore },
1047
- {
1048
- targetCoverage: 95,
1049
- framework: 'jest',
1050
- usePatterns: true,
1051
- reasoningBank: bank
1052
- }
1053
- );
1054
-
1055
- const result = await testGen.execute({
1056
- type: 'test-generation',
1057
- payload: {
1058
- sourceFile: 'src/user-service.ts',
1059
- framework: 'jest'
1060
- }
1061
- });
1062
-
1063
- console.log(`Generated ${result.testsGenerated} tests using ${result.patternsUsed.length} patterns`);
1064
- ```
1065
-
1066
- ### Example 2: Learning-Enhanced Coverage
1067
-
1068
- ```typescript
1069
- import {
1070
- CoverageAnalyzerAgent,
1071
- LearningEngine,
1072
- PerformanceTracker,
1073
- SwarmMemoryManager
1074
- } from 'agentic-qe';
1075
-
1076
- // Initialize components
1077
- const memory = new SwarmMemoryManager({ databasePath: './.aqe/memory.db' });
1078
- await memory.initialize();
1079
-
1080
- const learningEngine = new LearningEngine('coverage-1', memory, {
1081
- enabled: true,
1082
- learningRate: 0.1,
1083
- explorationRate: 0.3
1084
- });
1085
-
1086
- const performanceTracker = new PerformanceTracker('coverage-1', memory, {
1087
- targetImprovement: 0.20,
1088
- snapshotWindow: 100
1089
- });
1090
-
1091
- await learningEngine.initialize();
1092
- await performanceTracker.initialize();
1093
-
1094
- // Create agent with learning
1095
- const agent = new CoverageAnalyzerAgent(
1096
- {
1097
- agentId: 'coverage-1',
1098
- memoryStore: memory
1099
- },
1100
- {
1101
- targetCoverage: 95,
1102
- algorithm: 'sublinear',
1103
- enableLearning: true
1104
- }
1105
- );
1106
-
1107
- // Execute 100 tasks to build learning data
1108
- for (let i = 0; i < 100; i++) {
1109
- const result = await agent.execute({
1110
- type: 'coverage-analysis',
1111
- payload: {
1112
- coverageReport: `./coverage/report-${i}.json`,
1113
- threshold: 95
1114
- }
1115
- });
1116
-
1117
- console.log(`Task ${i + 1}/100: gaps=${result.gaps.length}`);
1118
- }
1119
-
1120
- // Check improvement
1121
- const improvement = await performanceTracker.calculateImprovement();
1122
- console.log(`\n🎯 Final Results:`);
1123
- console.log(`Improvement Rate: ${improvement.improvementRate.toFixed(2)}%`);
1124
- console.log(`Target Achieved: ${improvement.targetAchieved ? 'βœ… YES' : '❌ NO'}`);
1125
- ```
1126
-
1127
- ### Example 3: ML Flaky Detection
1128
-
1129
- ```typescript
1130
- import { FlakyTestDetector } from 'agentic-qe';
1131
-
1132
- const detector = new FlakyTestDetector({
1133
- minRuns: 5,
1134
- passRateThreshold: 0.8,
1135
- confidenceThreshold: 0.7
1136
- });
1137
-
1138
- const flakyTests = await detector.detectFlakyTests(testHistory);
479
+ ## πŸ“Š Performance Benchmarks
1139
480
 
1140
- flakyTests.forEach(test => {
1141
- console.log(`πŸ”΄ ${test.name}: ${(test.passRate * 100).toFixed(1)}%`);
1142
- console.log(` Pattern: ${test.failurePattern}`);
1143
- console.log(` Severity: ${test.severity}`);
1144
- console.log(` Fix: ${test.recommendation.suggestedFix}`);
1145
- });
1146
- ```
481
+ | Feature | Target | Actual | Status |
482
+ |---------|--------|--------|--------|
483
+ | **Pattern Matching (p95)** | <50ms | 32ms | βœ… Exceeded |
484
+ | **Learning Iteration** | <100ms | 68ms | βœ… Exceeded |
485
+ | **ML Flaky Detection (1000 tests)** | <500ms | 385ms | βœ… Exceeded |
486
+ | **Agent Memory** | <100MB | 85MB | βœ… Exceeded |
487
+ | **Cost Savings** | 70%+ | 70-81% | βœ… Achieved |
488
+ | **Test Improvement** | 20%+ | 23%+ | βœ… Exceeded |
489
+ | **Flaky Detection Accuracy** | 90%+ | 100% | βœ… Exceeded |
490
+ | **False Positive Rate** | <5% | 0% | βœ… Exceeded |
1147
491
 
1148
- More examples in [examples/](examples/)
492
+ ### Core Performance
493
+ - **Test Generation**: 1000+ tests/minute
494
+ - **Parallel Execution**: 10,000+ concurrent tests
495
+ - **Coverage Analysis**: O(log n) complexity
496
+ - **Data Generation**: 10,000+ records/second
497
+ - **Agent Spawning**: <100ms per agent
498
+ - **Memory Efficient**: <2GB for typical projects
1149
499
 
1150
500
  ---
1151
501
 
1152
- ## 🐳 Docker Deployment
502
+ ## πŸ“ Recent Changes
1153
503
 
1154
- ### Quick Start
504
+ ### v1.3.4 (2025-10-26) - Feature Implementation & Test Coverage
1155
505
 
1156
- ```bash
1157
- # Start with SQLite (development)
1158
- docker-compose up -d
506
+ **New Features:**
507
+ - Multi-Model Router: 85.7% cost savings (exceeds 70-81% promise)
508
+ - Pattern Bank with vector similarity (85%+ accuracy)
509
+ - ML Flaky Detection with automated fix recommendations (90%+ accuracy)
510
+ - Streaming API with AsyncGenerator pattern
511
+ - AgentDB Integration (150x vector search speedup)
1159
512
 
1160
- # Start with PostgreSQL (production)
1161
- docker-compose --profile postgres up -d
1162
- ```
1163
-
1164
- ### Production Deployment
513
+ **Improvements:**
514
+ - Test coverage improved from 1.67% to 50-70% (30-40x increase)
515
+ - Fixed 328 import paths across 122 test files
516
+ - Documentation consistency fixes (6 count errors corrected)
517
+ - All 17 QE agents updated with Phase 2 skill references
1165
518
 
1166
- ```bash
1167
- # Configure production environment
1168
- cp .env.example .env.production
1169
- # Edit .env.production with secure credentials
519
+ **Impact:** Production-ready release with 92/100 quality score, zero breaking changes, 100% backward compatible.
1170
520
 
1171
- # Deploy
1172
- docker-compose -f docker-compose.yml -f docker-compose.prod.yml up -d
1173
- ```
521
+ [View Complete Changelog](CHANGELOG.md)
1174
522
 
1175
523
  ---
1176
524
 
@@ -1212,37 +560,19 @@ npm test
1212
560
  ```
1213
561
  agentic-qe/
1214
562
  β”œβ”€β”€ src/
1215
- β”‚ β”œβ”€β”€ agents/ # Agent implementation classes (BaseAgent, LearningAgent, etc.)
563
+ β”‚ β”œβ”€β”€ agents/ # Agent implementation classes
1216
564
  β”‚ β”œβ”€β”€ core/ # Core fleet management
1217
- β”‚ β”‚ β”œβ”€β”€ FleetManager.ts
1218
- β”‚ β”‚ β”œβ”€β”€ Agent.ts
1219
- β”‚ β”‚ β”œβ”€β”€ Task.ts
1220
- β”‚ β”‚ β”œβ”€β”€ EventBus.ts
1221
- β”‚ β”‚ └── MemoryManager.ts
1222
565
  β”‚ β”œβ”€β”€ learning/ # Phase 2: Learning system
1223
- β”‚ β”‚ β”œβ”€β”€ LearningEngine.ts
1224
- β”‚ β”‚ β”œβ”€β”€ PerformanceTracker.ts
1225
- β”‚ β”‚ β”œβ”€β”€ ImprovementLoop.ts
1226
- β”‚ β”‚ β”œβ”€β”€ FlakyTestDetector.ts
1227
- β”‚ β”‚ └── FlakyPredictionModel.ts
1228
566
  β”‚ β”œβ”€β”€ reasoning/ # Phase 2: Pattern bank
1229
- β”‚ β”‚ β”œβ”€β”€ QEReasoningBank.ts
1230
- β”‚ β”‚ β”œβ”€β”€ PatternExtractor.ts
1231
- β”‚ β”‚ └── PatternMatcher.ts
1232
567
  β”‚ β”œβ”€β”€ cli/ # Command-line interface
1233
568
  β”‚ β”œβ”€β”€ mcp/ # Model Context Protocol server
1234
569
  β”‚ β”œβ”€β”€ types/ # TypeScript type definitions
1235
570
  β”‚ └── utils/ # Shared utilities
1236
571
  β”œβ”€β”€ tests/ # Comprehensive test suites
1237
- β”‚ β”œβ”€β”€ unit/
1238
- β”‚ β”œβ”€β”€ integration/
1239
- β”‚ β”œβ”€β”€ e2e/
1240
- β”‚ β”œβ”€β”€ performance/
1241
- β”‚ └── benchmarks/ # Phase 2: Performance benchmarks
1242
572
  β”œβ”€β”€ examples/ # Usage examples
1243
573
  β”œβ”€β”€ docs/ # Documentation
1244
574
  β”œβ”€β”€ .claude/ # Agent & command definitions
1245
- β”‚ β”œβ”€β”€ agents/ # 17 QE agent definitions (+ 1 general-purpose)
575
+ β”‚ β”œβ”€β”€ agents/ # 18 agent definitions
1246
576
  β”‚ └── commands/ # 8 AQE slash commands
1247
577
  └── config/ # Configuration files
1248
578
  ```
@@ -1274,21 +604,6 @@ We welcome contributions! Please see [CONTRIBUTING.md](CONTRIBUTING.md) for deta
1274
604
 
1275
605
  ---
1276
606
 
1277
- ## πŸ“ License
1278
-
1279
- This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
1280
-
1281
- ---
1282
-
1283
- ## πŸ™ Acknowledgments
1284
-
1285
- - Built with TypeScript, Node.js, and better-sqlite3
1286
- - Inspired by autonomous agent architectures and swarm intelligence
1287
- - Integrates with Jest, Cypress, Playwright, k6, SonarQube, and more
1288
- - Compatible with Claude Code via Model Context Protocol (MCP)
1289
-
1290
- ---
1291
-
1292
607
  ## πŸ“ž Support
1293
608
 
1294
609
  - **Documentation**: [docs/](docs/)
@@ -1300,18 +615,19 @@ This project is licensed under the MIT License - see the [LICENSE](LICENSE) file
1300
615
 
1301
616
  ## πŸ—ΊοΈ Roadmap
1302
617
 
1303
- ### Current (v1.1)
618
+ ### Current (v1.3)
1304
619
  - βœ… Learning System with Q-learning
1305
620
  - βœ… Pattern Bank with cross-project sharing
1306
621
  - βœ… ML Flaky Detection (100% accuracy)
1307
622
  - βœ… Continuous Improvement Loop
1308
- - βœ… 17 specialized QE agents
623
+ - βœ… 18 specialized agents
1309
624
  - βœ… Multi-framework test execution
1310
625
  - βœ… Real-time coverage analysis
1311
626
  - βœ… MCP integration
1312
627
  - βœ… Multi-model router (70-81% cost savings)
628
+ - βœ… 34 QE skills library
1313
629
 
1314
- ### Planned (v1.2)
630
+ ### Planned (v1.4)
1315
631
  - πŸ”„ Web dashboard for visualization
1316
632
  - πŸ”„ GraphQL API
1317
633
  - πŸ”„ CI/CD integrations (GitHub Actions, GitLab CI)
@@ -1327,6 +643,21 @@ This project is licensed under the MIT License - see the [LICENSE](LICENSE) file
1327
643
 
1328
644
  ---
1329
645
 
646
+ ## πŸ“ License
647
+
648
+ This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
649
+
650
+ ---
651
+
652
+ ## πŸ™ Acknowledgments
653
+
654
+ - Built with TypeScript, Node.js, and better-sqlite3
655
+ - Inspired by autonomous agent architectures and swarm intelligence
656
+ - Integrates with Jest, Cypress, Playwright, k6, SonarQube, and more
657
+ - Compatible with Claude Code via Model Context Protocol (MCP)
658
+
659
+ ---
660
+
1330
661
  <div align="center">
1331
662
 
1332
663
  **Made with ❀️ by the Agentic QE Team**