agentic-qe 3.7.9 → 3.7.11

package/assets/governance/shards/test-execution.shard.md

@@ -1,156 +1,156 @@
-# Test Execution Domain Shard
-
-**Domain**: test-execution
-**Version**: 1.0.0
-**Last Updated**: 2026-02-03
-**Parent Constitution**: `.claude/guidance/constitution.md`
-
----
-
-## Domain Rules
-
-1. **Execution Proof Required**: Every test execution claim MUST be backed by actual execution proof (timestamps, exit codes, output logs). No synthetic or assumed results.
-
-2. **Parallel Execution Safety**: Parallel test execution MUST use proper isolation (separate database instances, unique temp directories, non-conflicting ports).
-
-3. **Flaky Test Quarantine**: Tests identified as flaky (>10% failure variance across 5+ runs) MUST be quarantined and reported to the FlakyDetectorService.
-
-4. **Retry Policy Compliance**: Retry attempts MUST follow the configured RetryPolicy, with exponential backoff and maximum retry limits enforced.
-
-5. **E2E Test Integrity**: End-to-end tests MUST capture screenshots on failure and preserve browser state for debugging.
-
-6. **Prioritization Respect**: Test execution order MUST respect priorities assigned by TestPrioritizerService based on risk and change impact.
-
----
-
-## Quality Thresholds
-
-| Metric | Minimum | Target | Critical |
-|--------|---------|--------|----------|
-| Pass Rate | 0.8 | 0.95 | < 0.6 |
-| Execution Confidence | 0.7 | 0.9 | < 0.5 |
-| Flaky Rate | < 0.1 | < 0.05 | > 0.2 |
-| Retry Success Rate | 0.5 | 0.8 | < 0.3 |
-| E2E Reliability | 0.75 | 0.9 | < 0.5 |
-
----
-
-## Invariants
-
-```
-INVARIANT execution_proof_required:
-  FOR ALL claim IN execution_claims:
-    IF claim.status = 'passed' OR claim.status = 'failed' THEN
-      EXISTS proof WHERE
-        proof.claim_id = claim.id AND
-        proof.timestamp IS NOT NULL AND
-        proof.exit_code IS NOT NULL AND
-        proof.output_captured = true
-```
-
-```
-INVARIANT parallel_isolation:
-  FOR ALL parallel_run IN parallel_executions:
-    FOR ALL test_a, test_b IN parallel_run.concurrent_tests:
-      test_a.resource_namespace != test_b.resource_namespace
-```
-
-```
-INVARIANT flaky_quarantine:
-  FOR ALL test IN test_suite:
-    IF test.failure_variance > 0.1 AND test.run_count >= 5 THEN
-      test.quarantined = true
-```
-
-```
-INVARIANT retry_limit_enforcement:
-  FOR ALL retry_session IN retries:
-    retry_session.attempts <= retry_session.policy.max_retries
-```
-
----
-
-## Patterns
-
-**Domain Source**: `v3/src/domains/test-execution/`
-
-| Pattern | Location | Description |
-|---------|----------|-------------|
-| Test Executor Service | `services/test-executor.ts` | Core test execution engine |
-| Flaky Detector Service | `services/flaky-detector.ts` | Flaky test identification |
-| Retry Handler Service | `services/retry-handler.ts` | Intelligent retry logic |
-| Test Prioritizer Service | `services/test-prioritizer.ts` | Risk-based prioritization |
-| E2E Test Runner Service | `services/e2e-runner.ts` | Browser-based E2E execution |
-
-**E2E Step Types**: `types/index.ts` defines step types (NavigateStep, ClickStep, TypeStep, WaitStep, AssertStep, etc.).
-
----
-
-## Agent Constraints
-
-| Role | Agent ID | Permissions |
-|------|----------|-------------|
-| **Primary** | `qe-parallel-executor` | Full execution, parallel orchestration |
-| **Secondary** | `qe-flaky-hunter` | Flaky detection, quarantine decisions |
-| **Support** | `qe-test-architect` | Test selection guidance |
-| **Readonly** | `qe-quality-gate` | Results validation, no execution |
-
-**Forbidden Agents**: Agents MUST NOT execute tests without execution proof capability. No blind pass/fail claims.
-
----
-
-## Escalation Triggers
-
-| Trigger | Severity | Action |
-|---------|----------|--------|
-| Pass rate < 0.6 | CRITICAL | Escalate to Queen Coordinator, halt pipeline |
-| Flaky rate > 0.2 | CRITICAL | Escalate, initiate flaky test hunt |
-| Execution proof missing | CRITICAL | Block claim, escalate for investigation |
-| 3+ retries exhausted | HIGH | Escalate to Queen Coordinator |
-| Parallel isolation breach | HIGH | Halt parallel execution, escalate |
-| E2E screenshot capture failure | MEDIUM | Log warning, attempt recovery |
-| Prioritization conflict | LOW | Log, use default ordering |
-
----
-
-## Memory Namespace
-
-- **Namespace**: `qe-patterns/test-execution`
-- **Retention**: 30 days with minimum 3 uses
-- **Contradiction Check**: Enabled
-
----
-
-## Integration Points
-
-| Domain | Integration Type | Purpose |
-|--------|-----------------|---------|
-| `test-generation` | Input | Receive generated tests |
-| `coverage-analysis` | Output | Report coverage data |
-| `quality-assessment` | Output | Report execution results |
-| `defect-intelligence` | Output | Report failures for RCA |
-| `learning-optimization` | Bidirectional | Share execution patterns |
-
----
-
-## Execution Proof Schema
-
-```typescript
-interface ExecutionProof {
-  taskId: string;
-  testId: string;
-  status: 'passed' | 'failed' | 'skipped' | 'error';
-  timestamp: Date;
-  duration: number;
-  exitCode: number;
-  outputLog: string;
-  errorLog?: string;
-  screenshots?: string[]; // For E2E
-  retryCount: number;
-  isolationNamespace: string;
-}
-```
-
----
-
-*This shard is enforced by @claude-flow/guidance governance system.*
+# Test Execution Domain Shard
+
+**Domain**: test-execution
+**Version**: 1.0.0
+**Last Updated**: 2026-02-03
+**Parent Constitution**: `.claude/guidance/constitution.md`
+
+---
+
+## Domain Rules
+
+1. **Execution Proof Required**: Every test execution claim MUST be backed by actual execution proof (timestamps, exit codes, output logs). No synthetic or assumed results.
+
+2. **Parallel Execution Safety**: Parallel test execution MUST use proper isolation (separate database instances, unique temp directories, non-conflicting ports).
+
+3. **Flaky Test Quarantine**: Tests identified as flaky (>10% failure variance across 5+ runs) MUST be quarantined and reported to the FlakyDetectorService.
+
+4. **Retry Policy Compliance**: Retry attempts MUST follow the configured RetryPolicy, with exponential backoff and maximum retry limits enforced.
+
+5. **E2E Test Integrity**: End-to-end tests MUST capture screenshots on failure and preserve browser state for debugging.
+
+6. **Prioritization Respect**: Test execution order MUST respect priorities assigned by TestPrioritizerService based on risk and change impact.
+
+---
+
+## Quality Thresholds
+
+| Metric | Minimum | Target | Critical |
+|--------|---------|--------|----------|
+| Pass Rate | 0.8 | 0.95 | < 0.6 |
+| Execution Confidence | 0.7 | 0.9 | < 0.5 |
+| Flaky Rate | < 0.1 | < 0.05 | > 0.2 |
+| Retry Success Rate | 0.5 | 0.8 | < 0.3 |
+| E2E Reliability | 0.75 | 0.9 | < 0.5 |
+
+---
+
+## Invariants
+
+```
+INVARIANT execution_proof_required:
+  FOR ALL claim IN execution_claims:
+    IF claim.status = 'passed' OR claim.status = 'failed' THEN
+      EXISTS proof WHERE
+        proof.claim_id = claim.id AND
+        proof.timestamp IS NOT NULL AND
+        proof.exit_code IS NOT NULL AND
+        proof.output_captured = true
+```
+
+```
+INVARIANT parallel_isolation:
+  FOR ALL parallel_run IN parallel_executions:
+    FOR ALL test_a, test_b IN parallel_run.concurrent_tests:
+      test_a.resource_namespace != test_b.resource_namespace
+```
+
+```
+INVARIANT flaky_quarantine:
+  FOR ALL test IN test_suite:
+    IF test.failure_variance > 0.1 AND test.run_count >= 5 THEN
+      test.quarantined = true
+```
+
+```
+INVARIANT retry_limit_enforcement:
+  FOR ALL retry_session IN retries:
+    retry_session.attempts <= retry_session.policy.max_retries
+```
+
+---
+
+## Patterns
+
+**Domain Source**: `v3/src/domains/test-execution/`
+
+| Pattern | Location | Description |
+|---------|----------|-------------|
+| Test Executor Service | `services/test-executor.ts` | Core test execution engine |
+| Flaky Detector Service | `services/flaky-detector.ts` | Flaky test identification |
+| Retry Handler Service | `services/retry-handler.ts` | Intelligent retry logic |
+| Test Prioritizer Service | `services/test-prioritizer.ts` | Risk-based prioritization |
+| E2E Test Runner Service | `services/e2e-runner.ts` | Browser-based E2E execution |
+
+**E2E Step Types**: `types/index.ts` defines step types (NavigateStep, ClickStep, TypeStep, WaitStep, AssertStep, etc.).
+
+---
+
+## Agent Constraints
+
+| Role | Agent ID | Permissions |
+|------|----------|-------------|
+| **Primary** | `qe-parallel-executor` | Full execution, parallel orchestration |
+| **Secondary** | `qe-flaky-hunter` | Flaky detection, quarantine decisions |
+| **Support** | `qe-test-architect` | Test selection guidance |
+| **Readonly** | `qe-quality-gate` | Results validation, no execution |
+
+**Forbidden Agents**: Agents MUST NOT execute tests without execution proof capability. No blind pass/fail claims.
+
+---
+
+## Escalation Triggers
+
+| Trigger | Severity | Action |
+|---------|----------|--------|
+| Pass rate < 0.6 | CRITICAL | Escalate to Queen Coordinator, halt pipeline |
+| Flaky rate > 0.2 | CRITICAL | Escalate, initiate flaky test hunt |
+| Execution proof missing | CRITICAL | Block claim, escalate for investigation |
+| 3+ retries exhausted | HIGH | Escalate to Queen Coordinator |
+| Parallel isolation breach | HIGH | Halt parallel execution, escalate |
+| E2E screenshot capture failure | MEDIUM | Log warning, attempt recovery |
+| Prioritization conflict | LOW | Log, use default ordering |
+
+---
+
+## Memory Namespace
+
+- **Namespace**: `qe-patterns/test-execution`
+- **Retention**: 30 days with minimum 3 uses
+- **Contradiction Check**: Enabled
+
+---
+
+## Integration Points
+
+| Domain | Integration Type | Purpose |
+|--------|-----------------|---------|
+| `test-generation` | Input | Receive generated tests |
+| `coverage-analysis` | Output | Report coverage data |
+| `quality-assessment` | Output | Report execution results |
+| `defect-intelligence` | Output | Report failures for RCA |
+| `learning-optimization` | Bidirectional | Share execution patterns |
+
+---
+
+## Execution Proof Schema
+
+```typescript
+interface ExecutionProof {
+  taskId: string;
+  testId: string;
+  status: 'passed' | 'failed' | 'skipped' | 'error';
+  timestamp: Date;
+  duration: number;
+  exitCode: number;
+  outputLog: string;
+  errorLog?: string;
+  screenshots?: string[]; // For E2E
+  retryCount: number;
+  isolationNamespace: string;
+}
+```
+
+---
+
+*This shard is enforced by @claude-flow/guidance governance system.*

package/assets/governance/shards/test-generation.shard.md

@@ -1,128 +1,128 @@
-# Test Generation Domain Shard
-
-**Domain**: test-generation
-**Version**: 1.0.0
-**Last Updated**: 2026-02-03
-**Parent Constitution**: `.claude/guidance/constitution.md`
-
----
-
-## Domain Rules
-
-1. **Pattern-Driven Generation**: All test generation MUST leverage the PatternMatcherService to apply learned patterns before generating new tests from scratch.
-
-2. **Coherence Gate Requirement**: Generated tests MUST pass the TestGenerationCoherenceGate validation, ensuring they align with source requirements and do not contradict existing test specifications.
-
-3. **TDD Workflow Compliance**: When TDD mode is requested, tests MUST be generated BEFORE implementation code, with proper red-green-refactor cycle tracking.
-
-4. **Coverage Intent Verification**: Generated tests MUST target the coverage gaps identified by the coverage-analysis domain, not duplicate existing coverage.
-
-5. **No Mock Abuse**: Mock objects MUST be limited to external dependencies; internal service interactions SHOULD use real implementations when feasible.
-
-6. **Assertion Quality**: Each generated test MUST contain meaningful assertions (minimum 1 assertion per test case), not just execution checks.
-
----
-
-## Quality Thresholds
-
-| Metric | Minimum | Target | Critical |
-|--------|---------|--------|----------|
-| Quality Score | 0.7 | 0.85 | < 0.5 |
-| Confidence | 0.6 | 0.8 | < 0.4 |
-| Pattern Match Rate | 0.3 | 0.6 | N/A |
-| Coherence Score | 0.7 | 0.9 | < 0.5 |
-| Assertion Density | 1.0 | 2.5 | < 1.0 |
-
----
-
-## Invariants
-
-```
-INVARIANT test_generation_coherence:
-  FOR ALL generated_test IN test_output:
-    generated_test.coherence_score >= 0.7 AND
-    generated_test.assertions.length >= 1 AND
-    NOT EXISTS duplicate IN existing_tests WHERE
-      duplicate.coverage_target = generated_test.coverage_target AND
-      duplicate.assertion_set EQUALS generated_test.assertion_set
-```
-
-```
-INVARIANT tdd_workflow_integrity:
-  FOR ALL tdd_session IN tdd_sessions:
-    IF tdd_session.mode = 'strict' THEN
-      tdd_session.test_created_before_implementation = true
-```
-
-```
-INVARIANT pattern_application_before_generation:
-  FOR ALL generation_request IN requests:
-    EXISTS pattern_search_attempt WHERE
-      pattern_search_attempt.request_id = generation_request.id AND
-      pattern_search_attempt.completed = true
-```
-
----
-
-## Patterns
-
-**Domain Source**: `v3/src/domains/test-generation/`
-
-| Pattern | Location | Description |
-|---------|----------|-------------|
-| Test Generator Service | `services/test-generator.ts` | Core AI-powered test generation |
-| Pattern Matcher Service | `services/pattern-matcher.ts` | Learned pattern application |
-| Coherence Gate Service | `services/coherence-gate-service.ts` | Requirement alignment validation |
-| Test Generation Coordinator | `coordinator.ts` | Workflow orchestration |
-
-**Related Interfaces**: `interfaces/index.ts` defines `GenerateTestsRequest`, `TDDRequest`, `PropertyTestRequest`, and response types.
-
----
-
-## Agent Constraints
-
-| Role | Agent ID | Permissions |
-|------|----------|-------------|
-| **Primary** | `qe-test-architect` | Full test generation, pattern learning |
-| **Secondary** | `qe-tdd-specialist` | TDD workflow, red-green-refactor |
-| **Support** | `qe-coverage-specialist` | Gap identification for targeting |
-| **Readonly** | `qe-quality-gate` | Validation, no generation |
-
-**Forbidden Agents**: Agents without `test-generation` domain capability MUST NOT invoke test generation services directly.
-
----
-
-## Escalation Triggers
-
-| Trigger | Severity | Action |
-|---------|----------|--------|
-| Quality score < 0.5 | CRITICAL | Escalate to Queen Coordinator, halt generation |
-| Coherence score < 0.5 | CRITICAL | Escalate to Queen Coordinator, request requirement clarification |
-| Pattern match rate > 0.9 | WARNING | Log potential over-fitting, review patterns |
-| 3+ consecutive generation failures | HIGH | Escalate to Queen Coordinator, switch agent |
-| TDD sequence violation | MEDIUM | Log violation, notify coordinator |
-| Duplicate test detection | LOW | Auto-deduplicate, log pattern |
-
----
-
-## Memory Namespace
-
-- **Namespace**: `qe-patterns/test-generation`
-- **Retention**: 30 days with minimum 3 uses
-- **Contradiction Check**: Enabled
-
----
-
-## Integration Points
-
-| Domain | Integration Type | Purpose |
-|--------|-----------------|---------|
-| `coverage-analysis` | Input | Receive coverage gaps for targeting |
-| `requirements-validation` | Input | Receive BDD scenarios for test generation |
-| `test-execution` | Output | Provide generated tests for execution |
-| `learning-optimization` | Bidirectional | Share and receive patterns |
-| `quality-assessment` | Output | Submit tests for quality gate evaluation |
-
----
-
-*This shard is enforced by @claude-flow/guidance governance system.*
+# Test Generation Domain Shard
+
+**Domain**: test-generation
+**Version**: 1.0.0
+**Last Updated**: 2026-02-03
+**Parent Constitution**: `.claude/guidance/constitution.md`
+
+---
+
+## Domain Rules
+
+1. **Pattern-Driven Generation**: All test generation MUST leverage the PatternMatcherService to apply learned patterns before generating new tests from scratch.
+
+2. **Coherence Gate Requirement**: Generated tests MUST pass the TestGenerationCoherenceGate validation, ensuring they align with source requirements and do not contradict existing test specifications.
+
+3. **TDD Workflow Compliance**: When TDD mode is requested, tests MUST be generated BEFORE implementation code, with proper red-green-refactor cycle tracking.
+
+4. **Coverage Intent Verification**: Generated tests MUST target the coverage gaps identified by the coverage-analysis domain, not duplicate existing coverage.
+
+5. **No Mock Abuse**: Mock objects MUST be limited to external dependencies; internal service interactions SHOULD use real implementations when feasible.
+
+6. **Assertion Quality**: Each generated test MUST contain meaningful assertions (minimum 1 assertion per test case), not just execution checks.
+
+---
+
+## Quality Thresholds
+
+| Metric | Minimum | Target | Critical |
+|--------|---------|--------|----------|
+| Quality Score | 0.7 | 0.85 | < 0.5 |
+| Confidence | 0.6 | 0.8 | < 0.4 |
+| Pattern Match Rate | 0.3 | 0.6 | N/A |
+| Coherence Score | 0.7 | 0.9 | < 0.5 |
+| Assertion Density | 1.0 | 2.5 | < 1.0 |
+
+---
+
+## Invariants
+
+```
+INVARIANT test_generation_coherence:
+  FOR ALL generated_test IN test_output:
+    generated_test.coherence_score >= 0.7 AND
+    generated_test.assertions.length >= 1 AND
+    NOT EXISTS duplicate IN existing_tests WHERE
+      duplicate.coverage_target = generated_test.coverage_target AND
+      duplicate.assertion_set EQUALS generated_test.assertion_set
+```
+
+```
+INVARIANT tdd_workflow_integrity:
+  FOR ALL tdd_session IN tdd_sessions:
+    IF tdd_session.mode = 'strict' THEN
+      tdd_session.test_created_before_implementation = true
+```
+
+```
+INVARIANT pattern_application_before_generation:
+  FOR ALL generation_request IN requests:
+    EXISTS pattern_search_attempt WHERE
+      pattern_search_attempt.request_id = generation_request.id AND
+      pattern_search_attempt.completed = true
+```
+
+---
+
+## Patterns
+
+**Domain Source**: `v3/src/domains/test-generation/`
+
+| Pattern | Location | Description |
+|---------|----------|-------------|
+| Test Generator Service | `services/test-generator.ts` | Core AI-powered test generation |
+| Pattern Matcher Service | `services/pattern-matcher.ts` | Learned pattern application |
+| Coherence Gate Service | `services/coherence-gate-service.ts` | Requirement alignment validation |
+| Test Generation Coordinator | `coordinator.ts` | Workflow orchestration |
+
+**Related Interfaces**: `interfaces/index.ts` defines `GenerateTestsRequest`, `TDDRequest`, `PropertyTestRequest`, and response types.
+
+---
+
+## Agent Constraints
+
+| Role | Agent ID | Permissions |
+|------|----------|-------------|
+| **Primary** | `qe-test-architect` | Full test generation, pattern learning |
+| **Secondary** | `qe-tdd-specialist` | TDD workflow, red-green-refactor |
+| **Support** | `qe-coverage-specialist` | Gap identification for targeting |
+| **Readonly** | `qe-quality-gate` | Validation, no generation |
+
+**Forbidden Agents**: Agents without `test-generation` domain capability MUST NOT invoke test generation services directly.
+
+---
+
+## Escalation Triggers
+
+| Trigger | Severity | Action |
+|---------|----------|--------|
+| Quality score < 0.5 | CRITICAL | Escalate to Queen Coordinator, halt generation |
+| Coherence score < 0.5 | CRITICAL | Escalate to Queen Coordinator, request requirement clarification |
+| Pattern match rate > 0.9 | WARNING | Log potential over-fitting, review patterns |
+| 3+ consecutive generation failures | HIGH | Escalate to Queen Coordinator, switch agent |
+| TDD sequence violation | MEDIUM | Log violation, notify coordinator |
+| Duplicate test detection | LOW | Auto-deduplicate, log pattern |
+
+---
+
+## Memory Namespace
+
+- **Namespace**: `qe-patterns/test-generation`
+- **Retention**: 30 days with minimum 3 uses
+- **Contradiction Check**: Enabled
+
+---
+
+## Integration Points
+
+| Domain | Integration Type | Purpose |
+|--------|-----------------|---------|
+| `coverage-analysis` | Input | Receive coverage gaps for targeting |
+| `requirements-validation` | Input | Receive BDD scenarios for test generation |
+| `test-execution` | Output | Provide generated tests for execution |
+| `learning-optimization` | Bidirectional | Share and receive patterns |
+| `quality-assessment` | Output | Submit tests for quality gate evaluation |
+
+---
+
+*This shard is enforced by @claude-flow/guidance governance system.*