agentic-qe 2.2.1 → 2.2.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
|
@@ -20,6 +20,7 @@ Mission: Detect vulnerabilities using SAST/DAST, dependency scanning, and compli
|
|
|
20
20
|
⚠️ Partial:
|
|
21
21
|
- Advanced secret detection patterns
|
|
22
22
|
- AI-powered false positive filtering
|
|
23
|
+
- ✅ .gitignore verification before flagging secrets (prevents false positives)
|
|
23
24
|
|
|
24
25
|
❌ Planned:
|
|
25
26
|
- Automated vulnerability remediation
|
|
@@ -33,6 +34,31 @@ Detect vulnerabilities automatically and classify by severity (critical, high, m
|
|
|
33
34
|
Report findings with CVSS scores and remediation guidance.
|
|
34
35
|
</default_to_action>
|
|
35
36
|
|
|
37
|
+
<false_positive_prevention>
|
|
38
|
+
CRITICAL: Before flagging secrets or sensitive files as vulnerabilities, ALWAYS verify:
|
|
39
|
+
|
|
40
|
+
1. **Check .gitignore first**: Before reporting .env, credentials, or secret files as exposed:
|
|
41
|
+
- Read the project's .gitignore file
|
|
42
|
+
- If the file is listed in .gitignore, it is NOT a critical vulnerability
|
|
43
|
+
- Only flag as CRITICAL if secrets are actually committed to git history
|
|
44
|
+
|
|
45
|
+
2. **Verify git tracking status**: Run `git ls-files <file>` to confirm if file is tracked
|
|
46
|
+
- If file is NOT tracked and IS in .gitignore = COMPLIANT (not a vulnerability)
|
|
47
|
+
- If file IS tracked despite .gitignore = CRITICAL (remove from history)
|
|
48
|
+
|
|
49
|
+
3. **Common false positives to avoid**:
|
|
50
|
+
- `.env` files that are in .gitignore (correct practice)
|
|
51
|
+
- Local config files excluded from version control
|
|
52
|
+
- Developer-specific settings files
|
|
53
|
+
|
|
54
|
+
4. **Accurate reporting**:
|
|
55
|
+
- If .env exists locally but is gitignored: Report as "✅ COMPLIANT: .env properly excluded via .gitignore"
|
|
56
|
+
- If .env is in git history: Report as "🔴 CRITICAL: .env committed to repository, rotation required"
|
|
57
|
+
- Check with: `git log --all --full-history -- .env` to verify history
|
|
58
|
+
|
|
59
|
+
This prevents recurring false positives that undermine trust in security scan results.
|
|
60
|
+
</false_positive_prevention>
|
|
61
|
+
|
|
36
62
|
<parallel_execution>
|
|
37
63
|
Run SAST and DAST scans simultaneously for faster results.
|
|
38
64
|
Execute multiple scanning tools in parallel for comparison.
|
package/CHANGELOG.md
CHANGED
|
@@ -7,6 +7,66 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
|
|
|
7
7
|
|
|
8
8
|
## [Unreleased]
|
|
9
9
|
|
|
10
|
+
## [2.2.2] - 2025-12-07
|
|
11
|
+
|
|
12
|
+
### Changed
|
|
13
|
+
|
|
14
|
+
#### Test Suite Consolidation (Issue #103)
|
|
15
|
+
Major test suite restructuring achieving 60% reduction in test code while maintaining coverage quality.
|
|
16
|
+
|
|
17
|
+
**Metrics:**
|
|
18
|
+
- **Files**: 426 → 197 (-229 files, -53.8%)
|
|
19
|
+
- **Lines**: 208,253 → 82,698 (-125,555 lines, -60.3%)
|
|
20
|
+
- **Large files (>600 lines)**: 149 → 25 (-83.2%)
|
|
21
|
+
- **Skipped tests**: 7 → 0 (-100%)
|
|
22
|
+
|
|
23
|
+
**Categories Deleted:**
|
|
24
|
+
- Phase 1/2/3 milestone tests (superseded by journey tests)
|
|
25
|
+
- MCP handler implementation tests (covered by contract tests)
|
|
26
|
+
- Comprehensive/exhaustive internal tests
|
|
27
|
+
- Duplicate algorithm tests (Q-learning, SARSA, Actor-Critic)
|
|
28
|
+
- Internal utility tests (Logger, migration tools)
|
|
29
|
+
- Mock-based tests with no real integration value
|
|
30
|
+
|
|
31
|
+
**High-Value Tests Preserved:**
|
|
32
|
+
- 7 journey tests (user workflows)
|
|
33
|
+
- CLI tests (user-facing commands)
|
|
34
|
+
- E2E tests (end-to-end workflows)
|
|
35
|
+
- Core infrastructure tests (memory, hooks, privacy)
|
|
36
|
+
- MCP contract tests (API stability)
|
|
37
|
+
- Unique integration tests (neural, multi-agent)
|
|
38
|
+
|
|
39
|
+
### Added
|
|
40
|
+
|
|
41
|
+
#### CI/CD Optimization
|
|
42
|
+
- **`.github/workflows/optimized-ci.yml`**: Parallel job execution for fast feedback
|
|
43
|
+
- Fast tests job (journeys + contracts)
|
|
44
|
+
- Infrastructure tests job (parallel)
|
|
45
|
+
- Coverage analysis on PRs
|
|
46
|
+
- Test dashboard with PR comments
|
|
47
|
+
- **`scripts/test-dashboard.js`**: Metrics visualization showing progress to targets
|
|
48
|
+
- **`scripts/test-ci-optimized.sh`**: Batched test execution script
|
|
49
|
+
- **New test scripts in package.json**:
|
|
50
|
+
- `npm run test:journeys` - Journey tests (user workflows)
|
|
51
|
+
- `npm run test:contracts` - Contract tests (API stability)
|
|
52
|
+
- `npm run test:infrastructure` - Infrastructure tests
|
|
53
|
+
- `npm run test:regression` - Regression tests (fixed bugs)
|
|
54
|
+
- `npm run test:fast` - Fast path (journeys + contracts)
|
|
55
|
+
- `npm run test:ci:optimized` - Full optimized CI suite
|
|
56
|
+
|
|
57
|
+
#### Coverage Thresholds
|
|
58
|
+
- **Global**: 80% lines, 75% branches
|
|
59
|
+
- **Critical paths** (core/, agents/): 85% coverage
|
|
60
|
+
|
|
61
|
+
#### Journey Tests
|
|
62
|
+
- `tests/journeys/init-bootstrap.test.ts` - System initialization
|
|
63
|
+
- `tests/journeys/test-generation.test.ts` - AI test generation
|
|
64
|
+
- `tests/journeys/test-execution.test.ts` - Test execution workflow
|
|
65
|
+
- `tests/journeys/coverage-analysis.test.ts` - Coverage gap detection
|
|
66
|
+
- `tests/journeys/quality-gate.test.ts` - Quality gate decisions
|
|
67
|
+
- `tests/journeys/flaky-detection.test.ts` - Flaky test hunting
|
|
68
|
+
- `tests/journeys/learning.test.ts` - Learning & improvement
|
|
69
|
+
|
|
10
70
|
## [2.2.1] - 2025-12-07
|
|
11
71
|
|
|
12
72
|
### Fixed
|
package/README.md
CHANGED
|
@@ -9,7 +9,7 @@
|
|
|
9
9
|
<img alt="NPM Downloads" src="https://img.shields.io/npm/dw/agentic-qe">
|
|
10
10
|
|
|
11
11
|
|
|
12
|
-
**Version 2.2.
|
|
12
|
+
**Version 2.2.2** | [Changelog](CHANGELOG.md) | [Contributors](CONTRIBUTORS.md) | [Issues](https://github.com/proffesor-for-testing/agentic-qe/issues) | [Discussions](https://github.com/proffesor-for-testing/agentic-qe/discussions)
|
|
13
13
|
|
|
14
14
|
> Agentic test automation with AI learning, real-time visualization, QUIC transport, testability scoring, OpenTelemetry observability, persistent event storage, constitutional AI governance, and intelligent model routing.
|
|
15
15
|
|
|
@@ -6,7 +6,7 @@
|
|
|
6
6
|
*/
|
|
7
7
|
export declare const SERVER_INSTRUCTIONS = "\n# Agentic QE Fleet - MCP Tool Guide\n\n## Overview\nAgentic QE provides 96 specialized quality engineering tools organized into a hierarchical system for efficient context usage.\n\n## Quick Start\n1. **Discover available tools:** Use `tools_discover` to see all domains\n2. **Load domain tools:** Use `tools_load_domain` to load specialized tools\n3. **Auto-loading:** Domain tools auto-load when relevant keywords are detected\n\n---\n\n## Core Tools (Always Available - 14 tools)\n\n### Fleet Management\n- `fleet_init` - Initialize QE fleet with topology\n- `agent_spawn` - Spawn specialized QE agent\n- `fleet_status` - Get fleet and agent status\n\n### Testing\n- `test_generate_enhanced` - AI test generation with pattern recognition\n- `test_execute_parallel` - Parallel test execution with retry\n- `test_report_comprehensive` - Multi-format test reports\n\n### Memory & Coordination\n- `memory_store` - Store data with TTL & namespacing\n- `memory_retrieve` - Retrieve stored data\n- `memory_query` - Pattern-based memory search\n\n### Quality & Orchestration\n- `quality_analyze` - Analyze quality metrics\n- `task_orchestrate` - Orchestrate tasks across agents\n- `task_status` - Check task progress\n\n### Discovery\n- `tools_discover` - List available tool domains\n- `tools_load_domain` - Load tools for a domain\n\n---\n\n## Domain Tools (Load as Needed)\n\n| Domain | Keywords | Tools | Use Case |\n|--------|----------|-------|----------|\n| **Security** | security, vulnerability, audit, owasp | 4 tools | Security scanning, vulnerability detection |\n| **Performance** | benchmark, bottleneck, profiling | 4 tools | Performance testing, bottleneck analysis |\n| **Coverage** | coverage, gap, uncovered | 5 tools | Coverage analysis, gap detection |\n| **Quality** | quality gate, deploy, release | 6 tools | Quality gates, deployment readiness |\n| **Flaky** | flaky, unstable, retry | 3 tools | Flaky test detection and stabilization |\n| **Visual** | screenshot, accessibility, wcag | 3 tools | Visual regression, accessibility testing |\n| **Requirements** | bdd, gherkin, acceptance | 2 tools | Requirements validation, BDD generation |\n\n### Loading Domain Tools\n```\n# Explicit load\ntools_load_domain({ domain: 'security' })\n\n# Auto-load: Just mention keywords in your request\n\"I need to run a security scan\" \u2192 Security tools auto-load\n```\n\n---\n\n## Specialized Tools (Expert Use)\n\n### Learning Domain (4 tools)\nFor persistent learning and pattern storage across sessions.\nLoad with: `tools_load_domain({ domain: 'learning' })`\n\n### Advanced Domain (7 tools)\nFor mutation testing, API contract validation, production incident replay.\nLoad with: `tools_load_domain({ domain: 'advanced' })`\n\n---\n\n## Best Practices\n\n1. **Start with core tools** - They handle 80% of use cases\n2. **Let auto-load work** - Mention keywords naturally\n3. **Use tools_discover** - When unsure what's available\n4. **Batch operations** - Use parallel execution for speed\n5. **Check fleet_status** - Monitor agent health\n\n---\n\n## Common Workflows\n\n### Test Generation & Execution\n1. `test_generate_enhanced` - Generate tests\n2. `test_execute_parallel` - Run tests\n3. `test_report_comprehensive` - Generate report\n\n### Quality Gate Check\n1. Load quality domain if not auto-loaded\n2. `quality_analyze` - Analyze metrics\n3. `qe_qualitygate_evaluate` - Make go/no-go decision\n\n### Security Audit\n1. `tools_load_domain({ domain: 'security' })`\n2. `qe_security_scan_comprehensive` - Full scan\n3. `qe_security_detect_vulnerabilities` - Detailed analysis\n\n---\n\n## Tool Naming Convention\nAll tools follow: `mcp__agentic_qe__<tool_name>`\n\nExample: `mcp__agentic_qe__test_generate_enhanced`\n";
|
|
8
8
|
export declare const SERVER_NAME = "agentic-qe";
|
|
9
|
-
export declare const SERVER_VERSION = "2.2.
|
|
9
|
+
export declare const SERVER_VERSION = "2.2.2";
|
|
10
10
|
/**
|
|
11
11
|
* Get formatted server info for MCP initialization
|
|
12
12
|
*/
|
|
@@ -119,7 +119,7 @@ All tools follow: \`mcp__agentic_qe__<tool_name>\`
|
|
|
119
119
|
Example: \`mcp__agentic_qe__test_generate_enhanced\`
|
|
120
120
|
`;
|
|
121
121
|
exports.SERVER_NAME = 'agentic-qe';
|
|
122
|
-
exports.SERVER_VERSION = '2.2.
|
|
122
|
+
exports.SERVER_VERSION = '2.2.2';
|
|
123
123
|
/**
|
|
124
124
|
* Get formatted server info for MCP initialization
|
|
125
125
|
*/
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "agentic-qe",
|
|
3
|
-
"version": "2.2.
|
|
3
|
+
"version": "2.2.2",
|
|
4
4
|
"description": "Agentic Quality Engineering Fleet System - AI-driven quality management platform with 41 QE skills, learning, pattern reuse, ML-based flaky detection, Multi-Model Router (70-81% cost savings), streaming progress updates, 84 MCP tools with lazy loading (87% context reduction), and native TypeScript hooks",
|
|
5
5
|
"main": "dist/cli/index.js",
|
|
6
6
|
"types": "dist/cli/index.d.ts",
|
|
@@ -34,6 +34,19 @@
|
|
|
34
34
|
"test:cli": "node --expose-gc --max-old-space-size=512 --no-compilation-cache node_modules/.bin/jest tests/cli --runInBand --forceExit",
|
|
35
35
|
"test:agentdb": "node --expose-gc --max-old-space-size=1024 --no-compilation-cache node_modules/.bin/jest tests/agentdb --runInBand --forceExit",
|
|
36
36
|
"test:benchmark": "node --expose-gc --max-old-space-size=2048 --no-compilation-cache node_modules/.bin/jest tests/benchmarks --runInBand --forceExit",
|
|
37
|
+
"pretest:journeys": "node scripts/check-memory-before-test.js",
|
|
38
|
+
"test:journeys": "node --expose-gc --max-old-space-size=1024 --no-compilation-cache node_modules/.bin/jest tests/journeys --runInBand --forceExit --testTimeout=60000",
|
|
39
|
+
"pretest:contracts": "node scripts/check-memory-before-test.js",
|
|
40
|
+
"test:contracts": "node --expose-gc --max-old-space-size=512 --no-compilation-cache node_modules/.bin/jest tests/contracts --runInBand --forceExit",
|
|
41
|
+
"pretest:infrastructure": "node scripts/check-memory-before-test.js",
|
|
42
|
+
"test:infrastructure": "node --expose-gc --max-old-space-size=768 --no-compilation-cache node_modules/.bin/jest tests/infrastructure --runInBand --forceExit",
|
|
43
|
+
"pretest:regression": "node scripts/check-memory-before-test.js",
|
|
44
|
+
"test:regression": "node --expose-gc --max-old-space-size=512 --no-compilation-cache node_modules/.bin/jest tests/regression --runInBand --forceExit",
|
|
45
|
+
"pretest:fast": "node scripts/check-memory-before-test.js",
|
|
46
|
+
"test:fast": "node --expose-gc --max-old-space-size=768 --no-compilation-cache node_modules/.bin/jest tests/journeys tests/contracts --runInBand --forceExit --testTimeout=60000",
|
|
47
|
+
"pretest:ci:optimized": "node scripts/check-memory-before-test.js",
|
|
48
|
+
"test:ci:optimized": "bash scripts/test-ci-optimized.sh",
|
|
49
|
+
"test:dashboard": "node scripts/test-dashboard.js",
|
|
37
50
|
"pretest:phase2": "node scripts/check-memory-before-test.js",
|
|
38
51
|
"test:phase2": "node --expose-gc --max-old-space-size=1024 --no-compilation-cache node_modules/.bin/jest tests/phase2 --runInBand --forceExit",
|
|
39
52
|
"pretest:integration:phase2": "node scripts/check-memory-before-test.js",
|