ai-qakit 1.0.0

package/templates/.claude/commands/qakit/review/coverage.md

@@ -0,0 +1,116 @@
+# Analyze Test Coverage
+
+Analyze test coverage and identify gaps.
+
+## Usage
+
+```
+/qakit:review/coverage [path]
+```
+
+## Instructions
+
+Analyze test coverage comprehensively:
+
+1. **Gather Coverage Data**
+   - Run coverage tool if available
+   - Parse coverage reports
+   - Identify uncovered areas
+
+2. **Analyze Coverage Types**
+
+   **Line Coverage**
+   - Which lines are not executed?
+   - Are they reachable code?
+
+   **Branch Coverage**
+   - Which branches are not tested?
+   - Missing if/else paths?
+
+   **Function Coverage**
+   - Which functions are not called?
+   - Are they dead code?
+
+   **Statement Coverage**
+   - Which statements are missed?
+   - Critical logic uncovered?
+
+3. **Identify Coverage Gaps**
+   - Critical paths without tests
+   - Error handling not tested
+   - Edge cases missing
+   - Integration points uncovered
+
+4. **Generate Coverage Report**
+   ```markdown
+   # Test Coverage Analysis
+   
+   ## Summary
+   | Metric | Current | Target | Status |
+   |--------|---------|--------|--------|
+   | Statements | 75% | 80% | ⚠️ Below |
+   | Branches | 68% | 80% | ❌ Below |
+   | Functions | 82% | 80% | ✅ Met |
+   | Lines | 76% | 80% | ⚠️ Below |
+   
+   ## Coverage by Module
+   | Module | Statements | Branches | Functions |
+   |--------|------------|----------|-----------|
+   | auth/ | 90% | 85% | 95% |
+   | api/ | 70% | 60% | 75% |
+   | utils/ | 95% | 90% | 100% |
+   
+   ## Critical Gaps
+   
+   ### High Priority (Must Cover)
+   | File | Lines | Reason |
+   |------|-------|--------|
+   | `auth/login.ts` | 45-52 | Error handling |
+   | `api/users.ts` | 78-85 | Validation logic |
+   
+   ### Medium Priority
+   | File | Lines | Reason |
+   |------|-------|--------|
+   | `utils/format.ts` | 23-30 | Edge cases |
+   
+   ## Uncovered Code Analysis
+   
+   ### `src/auth/login.ts`
+   ```typescript
+   // Lines 45-52 not covered
+   if (user.isLocked) {  // Branch not tested
+     throw new AccountLockedException();
+   }
+   ```
+   **Suggested Test:**
+   ```typescript
+   it('should throw when account is locked', () => {
+     // Test implementation
+   });
+   ```
+   
+   ## Recommendations
+   1. Add tests for error handling in auth module
+   2. Cover validation branches in API module
+   3. Consider removing dead code in utils
+   
+   ## Test Suggestions
+   | Gap | Suggested Test |
+   |-----|----------------|
+   | Locked account | `auth.test.ts: handles locked account` |
+   | Invalid input | `api.test.ts: validates user input` |
+   ```
+
+5. **Prioritize Coverage Improvements**
+   - Critical business logic first
+   - Error handling paths
+   - Security-related code
+   - Frequently changed code
+
+## Output
+
+- Coverage analysis report
+- Prioritized gap list
+- Suggested tests to add
+
+$ARGUMENTS

package/templates/.claude/commands/qakit/review/quality-gate.md

@@ -0,0 +1,126 @@
+# Check Quality Gates
+
+Check if code meets quality gate criteria for release.
+
+## Usage
+
+```
+/qakit:review/quality-gate [--strict]
+```
+
+## Instructions
+
+Evaluate quality gates:
+
+1. **Define Quality Criteria**
+   ```yaml
+   quality_gates:
+     coverage:
+       statements: 80%
+       branches: 75%
+       functions: 80%
+       lines: 80%
+     
+     tests:
+       passing: 100%
+       no_skipped: true
+       no_flaky: true
+     
+     code_quality:
+       no_critical_issues: true
+       no_high_issues: true
+       max_medium_issues: 5
+     
+     security:
+       no_critical_vulnerabilities: true
+       no_high_vulnerabilities: true
+     
+     performance:
+       max_bundle_size: 500KB
+       max_load_time: 3s
+   ```
+
+2. **Run Quality Checks**
+   - Execute test suite
+   - Run coverage analysis
+   - Run linting/static analysis
+   - Check security vulnerabilities
+   - Measure performance metrics
+
+3. **Generate Quality Gate Report**
+   ```markdown
+   # Quality Gate Report
+   
+   **Date**: <date>
+   **Branch**: <branch>
+   **Commit**: <commit>
+   
+   ## Overall Status: ✅ PASSED / ❌ FAILED
+   
+   ## Test Results
+   | Check | Status | Value | Threshold |
+   |-------|--------|-------|-----------|
+   | Tests Passing | ✅ | 100% | 100% |
+   | No Skipped Tests | ✅ | 0 | 0 |
+   | No Flaky Tests | ✅ | 0 | 0 |
+   
+   ## Coverage
+   | Metric | Status | Value | Threshold |
+   |--------|--------|-------|-----------|
+   | Statements | ✅ | 85% | 80% |
+   | Branches | ⚠️ | 78% | 75% |
+   | Functions | ✅ | 90% | 80% |
+   | Lines | ✅ | 84% | 80% |
+   
+   ## Code Quality
+   | Check | Status | Count | Threshold |
+   |-------|--------|-------|-----------|
+   | Critical Issues | ✅ | 0 | 0 |
+   | High Issues | ✅ | 0 | 0 |
+   | Medium Issues | ✅ | 3 | 5 |
+   
+   ## Security
+   | Check | Status | Count | Threshold |
+   |-------|--------|-------|-----------|
+   | Critical Vulnerabilities | ✅ | 0 | 0 |
+   | High Vulnerabilities | ✅ | 0 | 0 |
+   
+   ## Performance
+   | Metric | Status | Value | Threshold |
+   |--------|--------|-------|-----------|
+   | Bundle Size | ✅ | 420KB | 500KB |
+   | Load Time | ✅ | 2.1s | 3s |
+   
+   ## Failed Checks (if any)
+   
+   ### ❌ Branch Coverage Below Threshold
+   - Current: 72%
+   - Required: 75%
+   - Gap: 3%
+   - Files needing coverage:
+     - `src/api/users.ts` (65%)
+     - `src/auth/oauth.ts` (58%)
+   
+   ## Recommendations
+   - [ ] Add tests for uncovered branches
+   - [ ] Fix medium priority issues
+   - [ ] Update dependencies with vulnerabilities
+   
+   ## Release Decision
+   - [ ] **APPROVED** - All gates passed
+   - [ ] **BLOCKED** - Critical gates failed
+   - [ ] **CONDITIONAL** - Non-critical gates failed, needs approval
+   ```
+
+4. **Provide Actionable Feedback**
+   - List specific files/issues to fix
+   - Prioritize by impact
+   - Suggest quick wins
+
+## Output
+
+- Quality gate report
+- Pass/fail status
+- Remediation suggestions
+
+$ARGUMENTS

package/templates/.claude/commands/qakit/review/test-code.md

@@ -0,0 +1,320 @@
+# Review Test Code
+
+Review test code against QA best practices and automation standards.
+
+## Usage
+
+```
+/qakit:review/test-code [file-path | folder-path | --changed]
+```
+
+## Options
+
+| Option | Description |
+|--------|-------------|
+| `file-path` | Review specific test file |
+| `folder-path` | Review all tests in folder |
+| `--changed` | Review only changed test files |
+| `--changed staged` | Review only staged test files |
+
+## Examples
+
+```bash
+/qakit:review/test-code tests/login.spec.ts
+/qakit:review/test-code e2e/
+/qakit:review/test-code --changed
+```
+
+## Instructions
+
+### Step 1: Detect Test Framework
+
+Scan project to identify test framework:
+- `playwright.config.ts` → Playwright
+- `wdio.*.conf.ts` → WebdriverIO
+- `cypress.config.ts` → Cypress
+- `jest.config.ts` → Jest
+- `vitest.config.ts` → Vitest
+
+### Step 2: Validate Input
+
+**If no arguments provided:**
+Ask user what to review:
+- Specific test file
+- Test folder/directory
+- Changed test files
+- All test files
+
+**If `--changed` flag:**
+```bash
+# Get changed test files
+git diff --name-only HEAD 2>/dev/null | grep -E "\.(spec|test)\.(ts|js)$"
+```
+
+**If file/folder path:**
+Verify path exists and contains test files.
+
+### Step 3: Analyze Test Code
+
+For each test file, check against QA standards:
+
+```
+════════════════════════════════════════════════════════════════════
+                    📋 TEST CODE REVIEW CHECKLIST
+════════════════════════════════════════════════════════════════════
+
+TARGET: [file/folder]
+FRAMEWORK: [detected framework]
+
+TEST QUALITY CHECK:
+
+1. TEST STRUCTURE
+   □ Follows AAA pattern (Arrange-Act-Assert)?
+   □ Tests are independent (no shared state)?
+   □ Proper describe/test grouping?
+   □ Meaningful test names?
+   □ One assertion per test (when possible)?
+
+2. PAGE OBJECT MODEL
+   □ Uses Page Objects (not raw selectors)?
+   □ Selectors encapsulated in POM?
+   □ Semantic method names?
+   □ Base class inheritance?
+   □ No business logic in POMs?
+
+3. SELECTORS
+   □ Uses data-testid attributes?
+   □ No fragile CSS selectors?
+   □ No XPath (unless necessary)?
+   □ Accessible selectors (role, label)?
+   □ No index-based selectors?
+
+4. WAITS & TIMING
+   □ No hard waits (waitForTimeout)?
+   □ Uses explicit waits?
+   □ Proper timeout configuration?
+   □ Handles async operations?
+
+5. TEST DATA
+   □ Uses fixtures/factories?
+   □ No hardcoded test data?
+   □ Data cleanup after tests?
+   □ Environment-specific data?
+
+6. ERROR HANDLING
+   □ Proper try-catch where needed?
+   □ Meaningful error messages?
+   □ Screenshots on failure?
+   □ Trace/video capture?
+
+7. ASSERTIONS
+   □ Uses proper matchers?
+   □ Soft assertions where appropriate?
+   □ Custom error messages?
+   □ No redundant assertions?
+
+8. MAINTAINABILITY
+   □ DRY - No duplicated code?
+   □ Reusable helper functions?
+   □ Proper file organization?
+   □ Comments explain "why"?
+
+9. PERFORMANCE
+   □ Parallel execution ready?
+   □ No unnecessary waits?
+   □ Efficient selectors?
+   □ Proper test isolation?
+
+10. CI/CD READINESS
+    □ Headless mode support?
+    □ Environment variables?
+    □ Retry configuration?
+    □ Report generation?
+
+════════════════════════════════════════════════════════════════════
+```
+
+### Step 4: Generate Violation Report
+
+```
+════════════════════════════════════════════════════════════════════
+                    🚨 TEST CODE VIOLATIONS
+════════════════════════════════════════════════════════════════════
+
+SUMMARY:
+  Total Files: [X]
+  Files with Violations: [Y]
+  Total Violations: [Z]
+
+VIOLATIONS BY SEVERITY:
+  🔴 Critical: [count] - Flaky tests, broken patterns
+  🟠 Major: [count] - Maintainability issues
+  🟡 Minor: [count] - Style, best practices
+
+DETAILED VIOLATIONS:
+
+[FILE: tests/login.spec.ts]
+
+1. 🔴 [CRITICAL] Hard Wait Found
+   Line 45: `await page.waitForTimeout(5000)`
+   Rule: "Never use hard waits"
+   Fix: Use `await page.waitForSelector()` or `expect().toBeVisible()`
+
+2. 🔴 [CRITICAL] Raw Selector in Test
+   Line 23: `await page.click('.btn-primary')`
+   Rule: "Use Page Objects for selectors"
+   Fix: Move to LoginPage.clickSubmitButton()
+
+3. 🟠 [MAJOR] Missing Test Isolation
+   Line 10: Uses shared `user` variable across tests
+   Rule: "Tests must be independent"
+   Fix: Create user in beforeEach or use fixtures
+
+4. 🟠 [MAJOR] Hardcoded Test Data
+   Line 15: `const email = 'test@example.com'`
+   Rule: "Use fixtures for test data"
+   Fix: Use `testData.users.validUser.email`
+
+5. 🟡 [MINOR] Generic Test Name
+   Line 8: `test('should work')`
+   Rule: "Use descriptive test names"
+   Fix: `test('should login successfully with valid credentials')`
+
+════════════════════════════════════════════════════════════════════
+```
+
+### Step 5: Auto-Fix Violations
+
+Ask user for fix strategy:
+- Fix all violations automatically
+- Fix only critical violations
+- Show each fix before applying
+- Let me choose which to fix
+
+**Common Auto-Fixes:**
+
+1. **Hard Waits → Explicit Waits**
+```typescript
+// Before
+await page.waitForTimeout(5000);
+
+// After
+await expect(page.locator('[data-testid="result"]')).toBeVisible();
+```
+
+2. **Raw Selectors → Page Objects**
+```typescript
+// Before
+await page.click('.submit-btn');
+
+// After
+await loginPage.clickSubmit();
+```
+
+3. **Hardcoded Data → Fixtures**
+```typescript
+// Before
+const email = 'test@example.com';
+
+// After
+const { email } = testData.users.validUser;
+```
+
+4. **Generic Names → Descriptive Names**
+```typescript
+// Before
+test('test 1', async () => {});
+
+// After
+test('should display error for invalid email format', async () => {});
+```
+
+### Step 6: Verification
+
+After fixes applied:
+
+```bash
+# Run linting
+npm run lint 2>&1 || echo "Lint skipped"
+
+# Type check
+npx tsc --noEmit 2>&1 || echo "Type check skipped"
+
+# Run affected tests
+npx playwright test [file] --reporter=list 2>&1 || echo "Tests skipped"
+```
+
+### Step 7: Final Report
+
+```
+════════════════════════════════════════════════════════════════════
+                    ✅ TEST CODE REVIEW COMPLETE
+════════════════════════════════════════════════════════════════════
+
+FILES REVIEWED: [X]
+
+VIOLATIONS FIXED:
+  🔴 Critical: [X] → 0
+  🟠 Major: [X] → 0
+  🟡 Minor: [X] → 0
+
+CHANGES MADE:
+  ✓ Replaced 3 hard waits with explicit waits
+  ✓ Moved 5 raw selectors to Page Objects
+  ✓ Extracted 4 hardcoded values to fixtures
+  ✓ Renamed 2 generic test names
+
+VERIFICATION:
+  ✓ Lint: Passed
+  ✓ Types: Valid
+  ✓ Tests: 12/12 passing
+
+TEST QUALITY SCORE: 92/100 (Excellent)
+
+RECOMMENDATIONS:
+  • Add data-testid to 3 elements missing them
+  • Consider adding visual regression tests
+  • Review test coverage for edge cases
+
+════════════════════════════════════════════════════════════════════
+```
+
+## Test Quality Rules Reference
+
+### The 10 Test Code Commandments
+
+1. **AAA Pattern** - Arrange, Act, Assert in every test
+2. **Independence** - Tests run in any order, no shared state
+3. **Page Objects** - Never use raw selectors in tests
+4. **Explicit Waits** - No hard waits, ever
+5. **Fixtures** - All test data from fixtures/factories
+6. **Descriptive Names** - Test name = documentation
+7. **Single Responsibility** - One behavior per test
+8. **Clean Assertions** - Clear, specific matchers
+9. **Error Context** - Screenshots, traces on failure
+10. **CI Ready** - Headless, parallel, retries configured
+
+### Selector Priority (Best to Worst)
+
+1. `data-testid` - Most stable
+2. `role` + `name` - Accessible
+3. `label` - Form elements
+4. `placeholder` - Input hints
+5. `text` - Visible content
+6. CSS class - Avoid if possible
+7. XPath - Last resort
+
+### Anti-Patterns to Detect
+
+| Anti-Pattern | Detection | Fix |
+|--------------|-----------|-----|
+| Hard waits | `waitForTimeout`, `sleep` | Explicit waits |
+| Raw selectors | Selectors in test files | Page Objects |
+| Shared state | Variables outside tests | Fixtures |
+| Flaky selectors | Index-based, nth-child | data-testid |
+| Missing cleanup | No afterEach | Add cleanup |
+| Console.log | Debug statements | Remove |
+| Skipped tests | `.skip`, `xit` | Fix or remove |
+| Commented tests | `// test(` | Remove |
+
+$ARGUMENTS

package/templates/.claude/commands/qakit/review/test-review.md

@@ -0,0 +1,109 @@
+# Review Test Quality
+
+Review test code quality and provide improvement suggestions.
+
+## Usage
+
+```
+/qakit:review/test-review <test-file-or-directory>
+```
+
+## Instructions
+
+Review test quality comprehensively:
+
+1. **Analyze Test Structure**
+   - Check test organization
+   - Verify naming conventions
+   - Assess test isolation
+
+2. **Evaluate Test Quality Criteria**
+
+   **Readability**
+   - Clear test names (describe what, not how)
+   - Proper arrange-act-assert structure
+   - Meaningful assertions
+
+   **Maintainability**
+   - DRY principles (shared setup, helpers)
+   - No hardcoded values
+   - Proper use of fixtures/factories
+
+   **Reliability**
+   - No flaky tests
+   - Proper async handling
+   - Independent tests (no order dependency)
+
+   **Coverage**
+   - Happy path covered
+   - Edge cases covered
+   - Error scenarios covered
+
+3. **Check for Anti-patterns**
+   - Tests testing implementation details
+   - Over-mocking
+   - Assertion-free tests
+   - Too many assertions per test
+   - Shared mutable state
+   - Sleep/timeout usage
+
+4. **Generate Review Report**
+   ```markdown
+   # Test Review Report
+   
+   ## Summary
+   - **Files Reviewed**: <count>
+   - **Total Tests**: <count>
+   - **Quality Score**: <score>/100
+   
+   ## Strengths
+   - ✅ <strength-1>
+   - ✅ <strength-2>
+   
+   ## Issues Found
+   
+   ### Critical
+   - ❌ <critical-issue>
+     - File: `<path>`
+     - Line: <line>
+     - Suggestion: <fix>
+   
+   ### Warnings
+   - ⚠️ <warning>
+     - File: `<path>`
+     - Suggestion: <fix>
+   
+   ### Suggestions
+   - 💡 <suggestion>
+   
+   ## Code Examples
+   
+   ### Before
+   ```typescript
+   // Anti-pattern example
+   ```
+   
+   ### After
+   ```typescript
+   // Improved version
+   ```
+   
+   ## Recommendations
+   1. <recommendation-1>
+   2. <recommendation-2>
+   ```
+
+## Quality Checklist
+
+- [ ] Tests have descriptive names
+- [ ] Each test tests one thing
+- [ ] Tests are independent
+- [ ] Proper setup/teardown
+- [ ] No hardcoded test data
+- [ ] Assertions are meaningful
+- [ ] Error cases are tested
+- [ ] No flaky tests
+- [ ] Proper async handling
+- [ ] Mocks are appropriate
+
+$ARGUMENTS