qa-skills 3.0.0

package/skills/qa-discovery-interview/templates/qa-brief-template.md

@@ -0,0 +1,168 @@
+---
+id: "{{brief_id}}"
+title: "QA Discovery Brief — {{project_name}}"
+project: "{{project_name}}"
+version: "{{document_version}}"
+date: "{{YYYY-MM-DD}}"
+interviewer: "{{interviewer}}"
+interviewee: "{{interviewee}}"
+status: "{{Draft | Reviewed | Approved}}"
+---
+
+# QA Discovery Brief — {{project_name}}
+
+## 1. Product Overview
+
+### 1.1 What We're Testing
+{{Brief description of the product/feature, its purpose, and core value proposition.}}
+
+### 1.2 Business Context
+- **Impact of defects:** {{What happens if this ships with bugs?}}
+- **User base:** {{Who uses it, how many, technical proficiency}}
+- **Project type:** {{New / Existing / Migration / Redesign}}
+
+## 2. Testing Scope & Objectives
+
+### 2.1 In Scope
+| Testing Type | Priority | Rationale |
+|-------------|----------|-----------|
+| {{Functional}} | {{P0}} | {{Core user flows}} |
+| {{Performance}} | {{P1}} | {{SLA requirements}} |
+| {{Security}} | {{P1}} | {{Handles PII}} |
+| {{Accessibility}} | {{P2}} | {{WCAG AA target}} |
+
+### 2.2 Out of Scope
+| Area | Reason |
+|------|--------|
+| {{area}} | {{rationale}} |
+
+### 2.3 Exit Criteria
+- [ ] {{exit_criterion_1}}
+- [ ] {{exit_criterion_2}}
+- [ ] {{exit_criterion_3}}
+
+## 3. Critical User Flows
+
+### Flow 1: {{flow_name}}
+{{Step-by-step description of the primary happy path.}}
+
+### Flow 2: {{flow_name}}
+{{Step-by-step description of the second critical flow.}}
+
+### Flow 3: {{flow_name}}
+{{Step-by-step description of the third critical flow.}}
+
+### Edge Cases & Negative Scenarios
+- {{edge_case_1}}
+- {{edge_case_2}}
+- {{negative_scenario_1}}
+
+## 4. Technical Landscape
+
+### 4.1 Technology Stack
+| Layer | Technology |
+|-------|-----------|
+| Frontend | {{framework, language}} |
+| Backend | {{framework, language}} |
+| Database | {{type, engine}} |
+| Infrastructure | {{cloud, hosting}} |
+
+### 4.2 Architecture
+{{Monolith / Microservices / Serverless / Hybrid — brief description.}}
+
+### 4.3 External Integrations
+| Service | Type | Mock Available? |
+|---------|------|-----------------|
+| {{service}} | {{API / webhook / SDK}} | {{Yes / No / Partial}} |
+
+### 4.4 Technical Constraints
+- {{constraint_1}}
+- {{constraint_2}}
+
+## 5. Risk Assessment
+
+| Risk | Probability | Impact | Mitigation |
+|------|-------------|--------|------------|
+| {{risk_1}} | {{High/Med/Low}} | {{High/Med/Low}} | {{action}} |
+| {{risk_2}} | {{High/Med/Low}} | {{High/Med/Low}} | {{action}} |
+| {{risk_3}} | {{High/Med/Low}} | {{High/Med/Low}} | {{action}} |
+
+### Defect History / Known Problem Areas
+- {{known_issue_1}}
+- {{known_issue_2}}
+
+## 6. Existing QA State
+
+### 6.1 Current Testing
+| Type | Coverage | Tools |
+|------|----------|-------|
+| {{Manual}} | {{areas}} | {{tool}} |
+| {{Automated}} | {{areas}} | {{framework}} |
+
+### 6.2 CI/CD Pipeline
+{{Description of current pipeline, what runs automatically, deployment process.}}
+
+### 6.3 Test Management
+{{Tools used: Jira, Qase, TestRail, spreadsheets, none.}}
+
+## 7. Team & Infrastructure
+
+### 7.1 Team
+| Role | Count | Automation Experience |
+|------|-------|----------------------|
+| {{QA}} | {{N}} | {{Junior/Mid/Senior}} |
+| {{Dev}} | {{N}} | {{unit test writing}} |
+
+### 7.2 Environments
+| Environment | Purpose | Status |
+|-------------|---------|--------|
+| {{dev}} | {{development}} | {{Active}} |
+| {{staging}} | {{pre-production}} | {{Active / Missing}} |
+
+### 7.3 Browser / Device Matrix
+| Browser/Device | Version | Priority |
+|---------------|---------|----------|
+| {{Chrome}} | {{latest}} | {{P0}} |
+| {{Safari/iOS}} | {{latest}} | {{P1}} |
+
+## 8. Compliance & Standards
+
+| Standard | Applicability | Level/Scope |
+|----------|--------------|-------------|
+| {{WCAG 2.2}} | {{Yes / No / TBD}} | {{Level AA}} |
+| {{OWASP}} | {{Yes / No / TBD}} | {{Top 10}} |
+| {{GDPR}} | {{Yes / No / TBD}} | {{EU users}} |
+| {{Industry-specific}} | {{Yes / No / TBD}} | {{scope}} |
+
+## 9. Recommendations
+
+### 9.1 Recommended Testing Approach
+{{Summary of recommended testing types, frameworks, and strategy.}}
+
+### 9.2 Recommended QA Skills Pipeline
+```
+{{skill_1}} → {{skill_2}} → {{skill_3}} → {{skill_4}}
+```
+
+### 9.3 Estimated Timeline
+| Phase | Duration | Activities |
+|-------|----------|------------|
+| {{Setup}} | {{X days}} | {{environment, tools, framework}} |
+| {{Test Design}} | {{X days}} | {{test cases, test data}} |
+| {{Automation}} | {{X days}} | {{test writing, CI integration}} |
+| {{Execution}} | {{X days}} | {{test runs, bug filing}} |
+
+## 10. Open Questions & Assumptions
+
+### Open Questions
+1. {{question_needing_follow_up}}
+2. {{question_needing_follow_up}}
+
+### Assumptions
+1. {{assumption_made_during_interview}}
+2. {{assumption_made_during_interview}}
+
+### Conflicts Resolved
+| Conflict | Resolution | Decided By |
+|----------|------------|------------|
+| {{conflict}} | {{resolution}} | {{stakeholder}} |

package/skills/qa-environment-checker/SKILL.md

@@ -0,0 +1,142 @@
+---
+name: qa-environment-checker
+description: Verify test environment readiness by checking services, databases, required accounts, configurations, dependencies, and tool availability before test execution.
+---
+
+# QA Environment Checker
+
+## Purpose
+
+Verify that the test environment is ready for test execution. Checks service health, database connectivity, required accounts, configuration files, dependencies, and tool availability. Produces an environment readiness report with pass/fail per check, setup instructions for failures, and automated fix suggestions.
+
+## Trigger Phrases
+
+- "Check test environment" / "Environment readiness"
+- "Verify environment before tests" / "Pre-test environment check"
+- "Is my test env ready?" / "Environment validation"
+- "Check services, DB, config before running tests"
+- "Environment setup verification"
+- "Dependency check for tests"
+- "Health check for test environment"
+
+## Checks Performed
+
+| Category | Checks |
+|----------|--------|
+| **Service health** | API endpoints responding (HTTP 2xx), health endpoints |
+| **Database** | Connectivity, schema state, migrations applied |
+| **Accounts/credentials** | Required test accounts exist; credentials valid |
+| **Configuration** | Config files present and valid (JSON, YAML, .env) |
+| **Dependencies** | Node.js, Python, Playwright browsers, npm/pnpm packages |
+| **Tools** | git, npm/pnpm/yarn, docker, CLI tools available |
+| **Environment variables** | .env validation; required vars set |
+| **Port availability** | Required ports free (e.g., 3000, 5432, 8080) |
+| **Disk space** | Sufficient space for test artifacts |
+| **Network** | Connectivity to external services if needed |
+
+See `references/health-checks.md` for service health patterns and `references/dependency-matrix.md` for dependency requirements by test type.
+
+## Output Format
+
+### Environment Readiness Report Template
+
+```markdown
+# Environment Readiness Report
+
+**Generated:** [timestamp]
+**Target:** [project/env name]
+
+## Summary
+| Status | Count |
+|--------|-------|
+| Pass   | X     |
+| Fail   | Y     |
+| Skip   | Z     |
+
+**Overall:** Ready / Not ready
+
+## Checks
+
+### [Category]: [Check name]
+- **Status:** Pass / Fail / Skip
+- **Details:** [output or error message]
+- **Fix (if failed):** [setup instructions or command]
+- **Auto-fix available:** Yes / No
+
+## Failed Checks Summary
+1. [Check] — [Brief fix]
+2. [Check] — [Brief fix]
+
+## Setup Instructions
+[Step-by-step for failed checks]
+
+## References
+- Health checks: references/health-checks.md
+- Dependency matrix: references/dependency-matrix.md
+```
+
+## Workflow
+
+1. **Identify scope** — User specifies project, test type (E2E, API, unit), or config path
+2. **Load dependency matrix** — Use `references/dependency-matrix.md` for required tools per test type
+3. **Run checks** — Execute health checks, connectivity tests, config validation
+4. **Collect results** — Pass/fail per check with details
+5. **Generate report** — Structured output per template
+6. **Provide fix suggestions** — Setup instructions, commands, or automated fix scripts for failures
+
+## Integration with Other Skills
+
+| Need | Skill | Usage |
+|------|-------|-------|
+| Run tests after env ready | qa-playwright-ts-writer, qa-pytest-writer | Environment checker runs first |
+| API contract for health | qa-api-contract-curator | Health endpoint specs |
+| Test data setup | qa-data-factory | Seed data after DB check passes |
+
+## Scope
+
+**Can do (autonomous):**
+- Check service health (HTTP requests to health endpoints)
+- Validate config files (syntax, required keys)
+- Verify tool availability (which, version commands)
+- Check env vars from .env (without exposing secrets)
+- Produce readiness report with fix suggestions
+- Reference health-checks and dependency-matrix
+
+**Cannot do (requires confirmation):**
+- Install dependencies or modify system (suggest only)
+- Create accounts or credentials
+- Run migrations (suggest commands only)
+- Modify production or shared environments
+
+**Will not do (out of scope):**
+- Execute actual tests (only verify environment)
+- Deploy or provision infrastructure
+- Access restricted systems without permission
+- Expose secrets in reports
+
+## References
+
+| Topic | File |
+|-------|------|
+| Service health check patterns | `references/health-checks.md` |
+| Dependency matrix by test type | `references/dependency-matrix.md` |
+
+## Quality Checklist
+
+- [ ] All relevant checks run per test type (see dependency-matrix)
+- [ ] Report includes pass/fail and fix suggestions for failures
+- [ ] No secrets exposed in report output
+- [ ] Setup instructions are actionable (commands, steps)
+- [ ] Skip reason documented when check skipped
+- [ ] References to health-checks and dependency-matrix correct
+
+## Troubleshooting
+
+| Symptom | Likely Cause | Fix |
+|---------|--------------|-----|
+| Health check fails but service works | Wrong URL, auth, or timeout | Verify health endpoint in config; check health-checks.md |
+| Dependency check reports missing | Wrong version or path | Update dependency-matrix for project stack |
+| Config validation fails | Schema mismatch | Compare expected vs actual schema; document in report |
+| Port check false positive | Process bound to different interface | Check 127.0.0.1 vs 0.0.0.0; document in health-checks |
+| Report too noisy | Too many checks | Scope to test type; use dependency-matrix to filter |
+| Auto-fix suggested but risky | Modifies system state | Mark as manual; require user confirmation |

package/skills/qa-environment-checker/references/dependency-matrix.md

@@ -0,0 +1,101 @@
+# Dependency Matrix for Test Types
+
+## Overview
+
+This reference defines which dependencies and tools are required for different test types. Use this to scope environment checks and avoid running irrelevant checks.
+
+## Test Type → Dependencies
+
+| Test Type | Runtime | Tools | Services | Config |
+|-----------|---------|-------|----------|--------|
+| **Unit (Jest/Vitest)** | Node.js | npm/pnpm, jest/vitest | None | package.json, jest.config |
+| **Unit (pytest)** | Python | pip, pytest | None | pyproject.toml, pytest.ini |
+| **E2E (Playwright TS)** | Node.js | npm/pnpm, Playwright, browsers | Optional API | playwright.config.ts |
+| **E2E (Playwright Py)** | Python | pip, Playwright, browsers | Optional API | pytest.ini, playwright |
+| **E2E (Cypress)** | Node.js | npm/pnpm, Cypress | Optional API | cypress.config.ts |
+| **API (Supertest/httpx)** | Node/Python | Runtime + HTTP client | API under test | BASE_URL, .env |
+| **API (Postman/k6)** | Node/standalone | Postman/k6 CLI | API under test | Collection, env vars |
+| **DB integration** | Runtime | DB client | Database | DATABASE_URL, migrations |
+| **Visual regression** | Node.js | Playwright/Percy/Backstop | App server | Screenshot config |
+| **Performance (k6)** | Standalone | k6 binary | Target URL | k6 script |
+| **Performance (JMeter)** | JVM | Java, JMeter | Target URL | .jmx plan |
+| **Security (ZAP)** | Java | Java, ZAP | Target URL | ZAP config |
+| **Mobile (Appium)** | Node/Python | Appium, drivers | Device/emulator | Appium config |
+
+## Runtime Version Requirements
+
+| Runtime | Minimum | Recommended |
+|---------|---------|-------------|
+| Node.js | 18.x | 20.x LTS |
+| Python | 3.10 | 3.12 |
+| Java (JMeter) | 11 | 17 |
+| Java (ZAP) | 11 | 17 |
+
+## Package Manager Checks
+
+| Manager | Check Command |
+|---------|---------------|
+| npm | `npm --version` |
+| pnpm | `pnpm --version` |
+| yarn | `yarn --version` |
+| pip | `pip --version` |
+| poetry | `poetry --version` |
+
+## Browser/Driver Checks
+
+| Tool | Check |
+|------|-------|
+| Playwright | `npx playwright install chromium` (or verify browsers exist) |
+| Cypress | `npx cypress verify` |
+| Chrome/Chromium | Path in PATH or known location |
+| WebDriver | chromedriver/geckodriver version |
+
+## Database Clients
+
+| DB | Package/Driver |
+|----|----------------|
+| PostgreSQL | psycopg2, pg, postgres.js |
+| MySQL | mysql-connector, mysql2 |
+| MongoDB | pymongo, mongodb |
+| SQLite | built-in (sqlite3) |
+| Redis | redis, ioredis |
+
+## Environment Variables by Test Type
+
+| Test Type | Typical Required Vars |
+|-----------|------------------------|
+| E2E | BASE_URL, (optional) TEST_USER, TEST_PASSWORD |
+| API | BASE_URL, API_KEY (if auth) |
+| DB | DATABASE_URL |
+| Auth tests | TEST_USER, TEST_PASSWORD, ADMIN_USER |
+| External services | MOCK_SERVER_URL, WEBHOOK_URL |
+
+## Config File Locations
+
+| Stack | Config Files |
+|-------|--------------|
+| Node/TS | package.json, tsconfig.json, .env |
+| Jest | jest.config.js, jest.config.ts |
+| Vitest | vitest.config.ts |
+| Playwright | playwright.config.ts |
+| Cypress | cypress.config.ts |
+| pytest | pyproject.toml, pytest.ini, conftest.py |
+| Robot | robot.yaml, variables.py |
+
+## Check Order Recommendation
+
+1. **Runtime** (Node/Python/Java) — Fail fast if missing
+2. **Package manager** — Required for install
+3. **Config files** — Present and valid
+4. **Dependencies installed** — node_modules, venv, etc.
+5. **Tools** (Playwright, Cypress) — If E2E
+6. **Services** (API, DB) — If integration/E2E
+7. **Env vars** — Required vars set
+8. **Ports** — If binding local server
+
+## Skipping Checks
+
+- **Unit-only:** Skip API, DB, browser checks
+- **API-only:** Skip browser, DB (unless API uses DB)
+- **E2E:** Run full matrix
+- **CI vs local:** CI may have different env (e.g., no browsers in headless runner)

package/skills/qa-environment-checker/references/health-checks.md

@@ -0,0 +1,209 @@
+# Service Health Check Patterns
+
+## Overview
+
+This reference documents patterns for verifying service health before test execution. Use these patterns when implementing environment checks for APIs, databases, and external services.
+
+## HTTP Health Endpoints
+
+### Basic GET Check
+
+```bash
+# Simple health check
+curl -s -o /dev/null -w "%{http_code}" http://localhost:3000/health
+# Expected: 200
+```
+
+### With Timeout
+
+```bash
+curl -s -o /dev/null -w "%{http_code}" --max-time 5 http://localhost:3000/health
+```
+
+### TypeScript/Node (fetch)
+
+```typescript
+async function checkHealth(url: string, timeoutMs = 5000): Promise<boolean> {
+  const controller = new AbortController();
+  const timeout = setTimeout(() => controller.abort(), timeoutMs);
+  try {
+    const res = await fetch(url, { signal: controller.signal });
+    clearTimeout(timeout);
+    return res.ok; // 2xx
+  } catch {
+    clearTimeout(timeout);
+    return false;
+  }
+}
+```
+
+### Python (httpx/requests)
+
+```python
+def check_health(url: str, timeout: float = 5.0) -> bool:
+    try:
+        r = httpx.get(url, timeout=timeout)
+        return 200 <= r.status_code < 300
+    except Exception:
+        return False
+```
+
+## Common Health Endpoint Paths
+
+| Framework/Stack | Typical Path | Notes |
+|-----------------|--------------|-------|
+| Express/Koa | `/health`, `/healthz`, `/ready` | Often custom |
+| Spring Boot | `/actuator/health` | JSON with status |
+| FastAPI | `/health`, `/docs` | OpenAPI at /docs |
+| Django | `/health/` | May need django-health-check |
+| Kubernetes | `/healthz`, `/readyz` | Liveness vs readiness |
+
+## Database Connectivity
+
+### PostgreSQL
+
+```bash
+pg_isready -h localhost -p 5432 -U testuser
+# Exit 0 = ready
+```
+
+```python
+# Python
+def check_postgres(conn_str: str) -> bool:
+    try:
+        with psycopg2.connect(conn_str) as conn:
+            conn.execute("SELECT 1")
+        return True
+    except Exception:
+        return False
+```
+
+### MySQL/MariaDB
+
+```bash
+mysqladmin ping -h localhost -u testuser -p
+```
+
+### MongoDB
+
+```bash
+mongosh --eval "db.adminCommand('ping')" --quiet
+# Exit 0 = ok
+```
+
+### SQLite
+
+```python
+def check_sqlite(path: str) -> bool:
+    try:
+        conn = sqlite3.connect(path, timeout=2)
+        conn.execute("SELECT 1")
+        conn.close()
+        return True
+    except Exception:
+        return False
+```
+
+## Redis
+
+```bash
+redis-cli ping
+# Expected: PONG
+```
+
+## Docker Services
+
+```bash
+# Check container running
+docker ps --filter "name=postgres" --format "{{.Status}}"
+# Expected: Up X minutes/hours
+
+# Check container health (if healthcheck defined)
+docker inspect --format='{{.State.Health.Status}}' postgres
+# Expected: healthy
+```
+
+## Port Availability
+
+### Check if port is in use
+
+```bash
+# Linux/macOS
+lsof -i :3000
+# Or
+netstat -tuln | grep 3000
+
+# Windows
+netstat -ano | findstr :3000
+```
+
+### Check if port is free (for binding)
+
+```python
+import socket
+def is_port_free(host: str, port: int) -> bool:
+    with socket.socket(socket.AF_INET, socket.SOCK_STREAM) as s:
+        try:
+            s.bind((host, port))
+            return True
+        except OSError:
+            return False
+```
+
+## Environment Variables
+
+### Required vars validation
+
+```python
+REQUIRED_VARS = ["DATABASE_URL", "API_KEY", "BASE_URL"]
+
+def check_env_vars() -> list[str]:
+    missing = [v for v in REQUIRED_VARS if not os.environ.get(v)]
+    return missing
+```
+
+### .env file presence and format
+
+- Check file exists
+- Parse and validate (no secrets in output)
+- Report missing required keys
+
+## Tool Availability
+
+### Version checks
+
+```bash
+node --version   # v18.x, v20.x
+python --version # 3.10+
+pnpm --version
+docker --version
+git --version
+```
+
+### Playwright browsers
+
+```bash
+npx playwright install --dry-run
+# Or
+npx playwright install chromium
+```
+
+## Retry and Backoff
+
+For flaky services, use retry with exponential backoff:
+
+```python
+def check_with_retry(check_fn, max_attempts=3, delay=2):
+    for i in range(max_attempts):
+        if check_fn():
+            return True
+        if i < max_attempts - 1:
+            time.sleep(delay * (2 ** i))
+    return False
+```
+
+## Security Notes
+
+- Never log or report full connection strings or secrets
+- Use masked values in reports (e.g., `DATABASE_URL=***@localhost`)
+- Prefer health endpoints over raw DB checks when available

package/skills/qa-environment-checker/templates/env-readiness-template.md

@@ -0,0 +1,64 @@
+# Environment Readiness Checklist
+
+**Environment:** {staging | UAT | production | local}
+**Date:** {YYYY-MM-DD}
+**Checked by:** {name}
+
+---
+
+## Services
+
+| Service | URL | Status | Notes |
+|---------|-----|--------|-------|
+| {service name} | {URL} | ☐ Up ☐ Down ☐ Unknown | |
+| {service name} | {URL} | ☐ Up ☐ Down ☐ Unknown | |
+| {service name} | {URL} | ☐ Up ☐ Down ☐ Unknown | |
+
+---
+
+## Database
+
+| Check | Status | Notes |
+|-------|--------|-------|
+| Connection | ☐ OK ☐ Fail | {connection string or host} |
+| Migrations applied | ☐ Yes ☐ No ☐ N/A | {version if applicable} |
+| Test data seeded | ☐ Yes ☐ No ☐ N/A | |
+
+---
+
+## Accounts
+
+| Account | Purpose | Status |
+|---------|---------|--------|
+| {user/role} | {purpose} | ☐ Ready ☐ Missing |
+| {user/role} | {purpose} | ☐ Ready ☐ Missing |
+
+---
+
+## Configuration
+
+- ☐ Config files present: {path}
+- ☐ Environment variables set: {list or N/A}
+- ☐ Feature flags: {enabled/disabled as expected}
+
+---
+
+## Dependencies & Tools
+
+| Tool | Required Version | Installed | Status |
+|------|------------------|-----------|--------|
+| {tool} | {version} | {version} | ☐ OK ☐ Missing |
+| {tool} | {version} | {version} | ☐ OK ☐ Missing |
+
+---
+
+## Ports & Network
+
+| Port | Service | Status |
+|------|---------|--------|
+| {port} | {service} | ☐ Open ☐ Blocked |
+| {port} | {service} | ☐ Open ☐ Blocked |
+
+---
+
+**Overall:** ☐ Ready for testing ☐ Not ready — blockers: {list}