@cregis-dev/cckit 0.4.0 → 0.5.0

package/templates/bmad/tea/workflows/testarch/test-review/steps-c/step-03a-subagent-determinism.md

@@ -1,214 +0,0 @@
----
-name: 'step-03a-subagent-determinism'
-description: 'Subagent: Check test determinism (no random/time dependencies)'
-subagent: true
-outputFile: '/tmp/tea-test-review-determinism-{{timestamp}}.json'
----
-
-# Subagent 3A: Determinism Quality Check
-
-## SUBAGENT CONTEXT
-
-This is an **isolated subagent** running in parallel with other quality dimension checks.
-
-**What you have from parent workflow:**
-
-- Test files discovered in Step 2
-- Knowledge fragment: test-quality (determinism criteria)
-- Config: test framework
-
-**Your task:** Analyze test files for DETERMINISM violations only.
-
----
-
-## MANDATORY EXECUTION RULES
-
-- 📖 Read this entire subagent file before acting
-- ✅ Check DETERMINISM only (not other quality dimensions)
-- ✅ Output structured JSON to temp file
-- ❌ Do NOT check isolation, maintainability, coverage, or performance (other subagents)
-- ❌ Do NOT modify test files (read-only analysis)
-- ❌ Do NOT run tests (just analyze code)
-
----
-
-## SUBAGENT TASK
-
-### 1. Identify Determinism Violations
-
-**Scan test files for non-deterministic patterns:**
-
-**HIGH SEVERITY Violations**:
-
-- `Math.random()` - Random number generation
-- `Date.now()` or `new Date()` without mocking
-- `setTimeout` / `setInterval` without proper waits
-- External API calls without mocking
-- File system operations on random paths
-- Database queries with non-deterministic ordering
-
-**MEDIUM SEVERITY Violations**:
-
-- `page.waitForTimeout(N)` - Hard waits instead of conditions
-- Flaky selectors (CSS classes that may change)
-- Race conditions (missing proper synchronization)
-- Test order dependencies (test A must run before test B)
-
-**LOW SEVERITY Violations**:
-
-- Missing test isolation (shared state between tests)
-- Console timestamps without fixed timezone
-
-### 2. Analyze Each Test File
-
-For each test file from Step 2:
-
-```javascript
-const violations = [];
-
-// Check for Math.random()
-if (testFileContent.includes('Math.random()')) {
-  violations.push({
-    file: testFile,
-    line: findLineNumber('Math.random()'),
-    severity: 'HIGH',
-    category: 'random-generation',
-    description: 'Test uses Math.random() - non-deterministic',
-    suggestion: 'Use faker.seed(12345) for deterministic random data',
-  });
-}
-
-// Check for Date.now()
-if (testFileContent.includes('Date.now()') || testFileContent.includes('new Date()')) {
-  violations.push({
-    file: testFile,
-    line: findLineNumber('Date.now()'),
-    severity: 'HIGH',
-    category: 'time-dependency',
-    description: 'Test uses Date.now() or new Date() without mocking',
-    suggestion: 'Mock system time with test.useFakeTimers() or use fixed timestamps',
-  });
-}
-
-// Check for hard waits
-if (testFileContent.includes('waitForTimeout')) {
-  violations.push({
-    file: testFile,
-    line: findLineNumber('waitForTimeout'),
-    severity: 'MEDIUM',
-    category: 'hard-wait',
-    description: 'Test uses waitForTimeout - creates flakiness',
-    suggestion: 'Replace with expect(locator).toBeVisible() or waitForResponse',
-  });
-}
-
-// ... check other patterns
-```
-
-### 3. Calculate Determinism Score
-
-**Scoring Logic**:
-
-```javascript
-const totalChecks = testFiles.length * checksPerFile;
-const failedChecks = violations.length;
-const passedChecks = totalChecks - failedChecks;
-
-// Weight violations by severity
-const severityWeights = { HIGH: 10, MEDIUM: 5, LOW: 2 };
-const totalPenalty = violations.reduce((sum, v) => sum + severityWeights[v.severity], 0);
-
-// Score: 100 - (penalty points)
-const score = Math.max(0, 100 - totalPenalty);
-```
-
----
-
-## OUTPUT FORMAT
-
-Write JSON to temp file: `/tmp/tea-test-review-determinism-{{timestamp}}.json`
-
-```json
-{
-  "dimension": "determinism",
-  "score": 85,
-  "max_score": 100,
-  "grade": "B",
-  "violations": [
-    {
-      "file": "tests/api/user.spec.ts",
-      "line": 42,
-      "severity": "HIGH",
-      "category": "random-generation",
-      "description": "Test uses Math.random() - non-deterministic",
-      "suggestion": "Use faker.seed(12345) for deterministic random data",
-      "code_snippet": "const userId = Math.random() * 1000;"
-    },
-    {
-      "file": "tests/e2e/checkout.spec.ts",
-      "line": 78,
-      "severity": "MEDIUM",
-      "category": "hard-wait",
-      "description": "Test uses waitForTimeout - creates flakiness",
-      "suggestion": "Replace with expect(locator).toBeVisible()",
-      "code_snippet": "await page.waitForTimeout(5000);"
-    }
-  ],
-  "passed_checks": 12,
-  "failed_checks": 3,
-  "total_checks": 15,
-  "violation_summary": {
-    "HIGH": 1,
-    "MEDIUM": 1,
-    "LOW": 1
-  },
-  "recommendations": [
-    "Use faker with fixed seed for all random data",
-    "Replace all waitForTimeout with conditional waits",
-    "Mock Date.now() in tests that use current time"
-  ],
-  "summary": "Tests are mostly deterministic with 3 violations (1 HIGH, 1 MEDIUM, 1 LOW)"
-}
-```
-
-**On Error:**
-
-```json
-{
-  "dimension": "determinism",
-  "success": false,
-  "error": "Error message describing what went wrong"
-}
-```
-
----
-
-## EXIT CONDITION
-
-Subagent completes when:
-
-- ✅ All test files analyzed for determinism violations
-- ✅ Score calculated (0-100)
-- ✅ Violations categorized by severity
-- ✅ Recommendations generated
-- ✅ JSON output written to temp file
-
-**Subagent terminates here.** Parent workflow will read output and aggregate with other quality dimensions.
-
----
-
-## 🚨 SUBAGENT SUCCESS METRICS
-
-### ✅ SUCCESS:
-
-- All test files scanned for determinism violations
-- Score calculated with proper severity weighting
-- JSON output valid and complete
-- Only determinism checked (not other dimensions)
-
-### ❌ FAILURE:
-
-- Checked quality dimensions other than determinism
-- Invalid or missing JSON output
-- Score calculation incorrect
-- Modified test files (should be read-only)

package/templates/bmad/tea/workflows/testarch/test-review/steps-c/step-03a-subprocess-determinism.md

@@ -1,214 +0,0 @@
----
-name: 'step-03a-subprocess-determinism'
-description: 'Subprocess: Check test determinism (no random/time dependencies)'
-subprocess: true
-outputFile: '/tmp/tea-test-review-determinism-{{timestamp}}.json'
----
-
-# Subprocess 3A: Determinism Quality Check
-
-## SUBPROCESS CONTEXT
-
-This is an **isolated subprocess** running in parallel with other quality dimension checks.
-
-**What you have from parent workflow:**
-
-- Test files discovered in Step 2
-- Knowledge fragment: test-quality (determinism criteria)
-- Config: test framework
-
-**Your task:** Analyze test files for DETERMINISM violations only.
-
----
-
-## MANDATORY EXECUTION RULES
-
-- 📖 Read this entire subprocess file before acting
-- ✅ Check DETERMINISM only (not other quality dimensions)
-- ✅ Output structured JSON to temp file
-- ❌ Do NOT check isolation, maintainability, coverage, or performance (other subprocesses)
-- ❌ Do NOT modify test files (read-only analysis)
-- ❌ Do NOT run tests (just analyze code)
-
----
-
-## SUBPROCESS TASK
-
-### 1. Identify Determinism Violations
-
-**Scan test files for non-deterministic patterns:**
-
-**HIGH SEVERITY Violations**:
-
-- `Math.random()` - Random number generation
-- `Date.now()` or `new Date()` without mocking
-- `setTimeout` / `setInterval` without proper waits
-- External API calls without mocking
-- File system operations on random paths
-- Database queries with non-deterministic ordering
-
-**MEDIUM SEVERITY Violations**:
-
-- `page.waitForTimeout(N)` - Hard waits instead of conditions
-- Flaky selectors (CSS classes that may change)
-- Race conditions (missing proper synchronization)
-- Test order dependencies (test A must run before test B)
-
-**LOW SEVERITY Violations**:
-
-- Missing test isolation (shared state between tests)
-- Console timestamps without fixed timezone
-
-### 2. Analyze Each Test File
-
-For each test file from Step 2:
-
-```javascript
-const violations = [];
-
-// Check for Math.random()
-if (testFileContent.includes('Math.random()')) {
-  violations.push({
-    file: testFile,
-    line: findLineNumber('Math.random()'),
-    severity: 'HIGH',
-    category: 'random-generation',
-    description: 'Test uses Math.random() - non-deterministic',
-    suggestion: 'Use faker.seed(12345) for deterministic random data',
-  });
-}
-
-// Check for Date.now()
-if (testFileContent.includes('Date.now()') || testFileContent.includes('new Date()')) {
-  violations.push({
-    file: testFile,
-    line: findLineNumber('Date.now()'),
-    severity: 'HIGH',
-    category: 'time-dependency',
-    description: 'Test uses Date.now() or new Date() without mocking',
-    suggestion: 'Mock system time with test.useFakeTimers() or use fixed timestamps',
-  });
-}
-
-// Check for hard waits
-if (testFileContent.includes('waitForTimeout')) {
-  violations.push({
-    file: testFile,
-    line: findLineNumber('waitForTimeout'),
-    severity: 'MEDIUM',
-    category: 'hard-wait',
-    description: 'Test uses waitForTimeout - creates flakiness',
-    suggestion: 'Replace with expect(locator).toBeVisible() or waitForResponse',
-  });
-}
-
-// ... check other patterns
-```
-
-### 3. Calculate Determinism Score
-
-**Scoring Logic**:
-
-```javascript
-const totalChecks = testFiles.length * checksPerFile;
-const failedChecks = violations.length;
-const passedChecks = totalChecks - failedChecks;
-
-// Weight violations by severity
-const severityWeights = { HIGH: 10, MEDIUM: 5, LOW: 2 };
-const totalPenalty = violations.reduce((sum, v) => sum + severityWeights[v.severity], 0);
-
-// Score: 100 - (penalty points)
-const score = Math.max(0, 100 - totalPenalty);
-```
-
----
-
-## OUTPUT FORMAT
-
-Write JSON to temp file: `/tmp/tea-test-review-determinism-{{timestamp}}.json`
-
-```json
-{
-  "dimension": "determinism",
-  "score": 85,
-  "max_score": 100,
-  "grade": "B",
-  "violations": [
-    {
-      "file": "tests/api/user.spec.ts",
-      "line": 42,
-      "severity": "HIGH",
-      "category": "random-generation",
-      "description": "Test uses Math.random() - non-deterministic",
-      "suggestion": "Use faker.seed(12345) for deterministic random data",
-      "code_snippet": "const userId = Math.random() * 1000;"
-    },
-    {
-      "file": "tests/e2e/checkout.spec.ts",
-      "line": 78,
-      "severity": "MEDIUM",
-      "category": "hard-wait",
-      "description": "Test uses waitForTimeout - creates flakiness",
-      "suggestion": "Replace with expect(locator).toBeVisible()",
-      "code_snippet": "await page.waitForTimeout(5000);"
-    }
-  ],
-  "passed_checks": 12,
-  "failed_checks": 3,
-  "total_checks": 15,
-  "violation_summary": {
-    "HIGH": 1,
-    "MEDIUM": 1,
-    "LOW": 1
-  },
-  "recommendations": [
-    "Use faker with fixed seed for all random data",
-    "Replace all waitForTimeout with conditional waits",
-    "Mock Date.now() in tests that use current time"
-  ],
-  "summary": "Tests are mostly deterministic with 3 violations (1 HIGH, 1 MEDIUM, 1 LOW)"
-}
-```
-
-**On Error:**
-
-```json
-{
-  "dimension": "determinism",
-  "success": false,
-  "error": "Error message describing what went wrong"
-}
-```
-
----
-
-## EXIT CONDITION
-
-Subprocess completes when:
-
-- ✅ All test files analyzed for determinism violations
-- ✅ Score calculated (0-100)
-- ✅ Violations categorized by severity
-- ✅ Recommendations generated
-- ✅ JSON output written to temp file
-
-**Subprocess terminates here.** Parent workflow will read output and aggregate with other quality dimensions.
-
----
-
-## 🚨 SUBPROCESS SUCCESS METRICS
-
-### ✅ SUCCESS:
-
-- All test files scanned for determinism violations
-- Score calculated with proper severity weighting
-- JSON output valid and complete
-- Only determinism checked (not other dimensions)
-
-### ❌ FAILURE:
-
-- Checked quality dimensions other than determinism
-- Invalid or missing JSON output
-- Score calculation incorrect
-- Modified test files (should be read-only)

package/templates/bmad/tea/workflows/testarch/test-review/steps-c/step-03b-subagent-isolation.md

@@ -1,125 +0,0 @@
----
-name: 'step-03b-subagent-isolation'
-description: 'Subagent: Check test isolation (no shared state/dependencies)'
-subagent: true
-outputFile: '/tmp/tea-test-review-isolation-{{timestamp}}.json'
----
-
-# Subagent 3B: Isolation Quality Check
-
-## SUBAGENT CONTEXT
-
-This is an **isolated subagent** running in parallel with other quality dimension checks.
-
-**Your task:** Analyze test files for ISOLATION violations only.
-
----
-
-## MANDATORY EXECUTION RULES
-
-- ✅ Check ISOLATION only (not other quality dimensions)
-- ✅ Output structured JSON to temp file
-- ❌ Do NOT check determinism, maintainability, coverage, or performance
-- ❌ Do NOT modify test files (read-only analysis)
-
----
-
-## SUBAGENT TASK
-
-### 1. Identify Isolation Violations
-
-**Scan test files for isolation issues:**
-
-**HIGH SEVERITY Violations**:
-
-- Global state mutations (global variables modified)
-- Test order dependencies (test B depends on test A running first)
-- Shared database records without cleanup
-- beforeAll/afterAll with side effects leaking to other tests
-
-**MEDIUM SEVERITY Violations**:
-
-- Missing test cleanup (created data not deleted)
-- Shared fixtures that mutate state
-- Tests that assume specific execution order
-- Environment variables modified without restoration
-
-**LOW SEVERITY Violations**:
-
-- Tests sharing test data (but not mutating)
-- Missing test.describe grouping
-- Tests that could be more isolated
-
-### 2. Calculate Isolation Score
-
-```javascript
-const totalChecks = testFiles.length * checksPerFile;
-const failedChecks = violations.length;
-const severityWeights = { HIGH: 10, MEDIUM: 5, LOW: 2 };
-const totalPenalty = violations.reduce((sum, v) => sum + severityWeights[v.severity], 0);
-const score = Math.max(0, 100 - totalPenalty);
-```
-
----
-
-## OUTPUT FORMAT
-
-```json
-{
-  "dimension": "isolation",
-  "score": 90,
-  "max_score": 100,
-  "grade": "A-",
-  "violations": [
-    {
-      "file": "tests/api/integration.spec.ts",
-      "line": 15,
-      "severity": "HIGH",
-      "category": "test-order-dependency",
-      "description": "Test depends on previous test creating user record",
-      "suggestion": "Each test should create its own test data in beforeEach",
-      "code_snippet": "test('should update user', async () => { /* assumes user exists */ });"
-    }
-  ],
-  "passed_checks": 14,
-  "failed_checks": 1,
-  "total_checks": 15,
-  "violation_summary": {
-    "HIGH": 1,
-    "MEDIUM": 0,
-    "LOW": 0
-  },
-  "recommendations": [
-    "Add beforeEach hooks to create test data",
-    "Add afterEach hooks to cleanup created records",
-    "Use test.describe.configure({ mode: 'parallel' }) to enforce isolation"
-  ],
-  "summary": "Tests are well isolated with 1 HIGH severity violation"
-}
-```
-
----
-
-## EXIT CONDITION
-
-Subagent completes when:
-
-- ✅ All test files analyzed for isolation violations
-- ✅ Score calculated
-- ✅ JSON output written to temp file
-
-**Subagent terminates here.**
-
----
-
-## 🚨 SUBAGENT SUCCESS METRICS
-
-### ✅ SUCCESS:
-
-- Only isolation checked (not other dimensions)
-- JSON output valid and complete
-
-### ❌ FAILURE:
-
-- Checked quality dimensions other than isolation
-- Invalid or missing JSON output

package/templates/bmad/tea/workflows/testarch/test-review/steps-c/step-03b-subprocess-isolation.md

@@ -1,125 +0,0 @@
----
-name: 'step-03b-subprocess-isolation'
-description: 'Subprocess: Check test isolation (no shared state/dependencies)'
-subprocess: true
-outputFile: '/tmp/tea-test-review-isolation-{{timestamp}}.json'
----
-
-# Subprocess 3B: Isolation Quality Check
-
-## SUBPROCESS CONTEXT
-
-This is an **isolated subprocess** running in parallel with other quality dimension checks.
-
-**Your task:** Analyze test files for ISOLATION violations only.
-
----
-
-## MANDATORY EXECUTION RULES
-
-- ✅ Check ISOLATION only (not other quality dimensions)
-- ✅ Output structured JSON to temp file
-- ❌ Do NOT check determinism, maintainability, coverage, or performance
-- ❌ Do NOT modify test files (read-only analysis)
-
----
-
-## SUBPROCESS TASK
-
-### 1. Identify Isolation Violations
-
-**Scan test files for isolation issues:**
-
-**HIGH SEVERITY Violations**:
-
-- Global state mutations (global variables modified)
-- Test order dependencies (test B depends on test A running first)
-- Shared database records without cleanup
-- beforeAll/afterAll with side effects leaking to other tests
-
-**MEDIUM SEVERITY Violations**:
-
-- Missing test cleanup (created data not deleted)
-- Shared fixtures that mutate state
-- Tests that assume specific execution order
-- Environment variables modified without restoration
-
-**LOW SEVERITY Violations**:
-
-- Tests sharing test data (but not mutating)
-- Missing test.describe grouping
-- Tests that could be more isolated
-
-### 2. Calculate Isolation Score
-
-```javascript
-const totalChecks = testFiles.length * checksPerFile;
-const failedChecks = violations.length;
-const severityWeights = { HIGH: 10, MEDIUM: 5, LOW: 2 };
-const totalPenalty = violations.reduce((sum, v) => sum + severityWeights[v.severity], 0);
-const score = Math.max(0, 100 - totalPenalty);
-```
-
----
-
-## OUTPUT FORMAT
-
-```json
-{
-  "dimension": "isolation",
-  "score": 90,
-  "max_score": 100,
-  "grade": "A-",
-  "violations": [
-    {
-      "file": "tests/api/integration.spec.ts",
-      "line": 15,
-      "severity": "HIGH",
-      "category": "test-order-dependency",
-      "description": "Test depends on previous test creating user record",
-      "suggestion": "Each test should create its own test data in beforeEach",
-      "code_snippet": "test('should update user', async () => { /* assumes user exists */ });"
-    }
-  ],
-  "passed_checks": 14,
-  "failed_checks": 1,
-  "total_checks": 15,
-  "violation_summary": {
-    "HIGH": 1,
-    "MEDIUM": 0,
-    "LOW": 0
-  },
-  "recommendations": [
-    "Add beforeEach hooks to create test data",
-    "Add afterEach hooks to cleanup created records",
-    "Use test.describe.configure({ mode: 'parallel' }) to enforce isolation"
-  ],
-  "summary": "Tests are well isolated with 1 HIGH severity violation"
-}
-```
-
----
-
-## EXIT CONDITION
-
-Subprocess completes when:
-
-- ✅ All test files analyzed for isolation violations
-- ✅ Score calculated
-- ✅ JSON output written to temp file
-
-**Subprocess terminates here.**
-
----
-
-## 🚨 SUBPROCESS SUCCESS METRICS
-
-### ✅ SUCCESS:
-
-- Only isolation checked (not other dimensions)
-- JSON output valid and complete
-
-### ❌ FAILURE:
-
-- Checked quality dimensions other than isolation
-- Invalid or missing JSON output