@keber/qa-framework 1.0.4
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +53 -0
- package/README.md +233 -0
- package/agent-instructions/00-module-analysis.md +263 -0
- package/agent-instructions/01-spec-generation.md +278 -0
- package/agent-instructions/02-test-plan-generation.md +202 -0
- package/agent-instructions/03-test-case-generation.md +147 -0
- package/agent-instructions/04-automation-generation.md +310 -0
- package/agent-instructions/04b-test-stabilization.md +306 -0
- package/agent-instructions/05-ado-integration.md +244 -0
- package/agent-instructions/06-maintenance.md +125 -0
- package/docs/architecture.md +227 -0
- package/docs/comparison-matrix.md +131 -0
- package/docs/final-report.md +279 -0
- package/docs/folder-structure-guide.md +291 -0
- package/docs/generalization-decisions.md +203 -0
- package/docs/installation.md +239 -0
- package/docs/spec-driven-philosophy.md +170 -0
- package/docs/usage-with-agent.md +203 -0
- package/examples/module-example/README.md +34 -0
- package/examples/module-example/suppliers/00-inventory.md +56 -0
- package/examples/module-example/suppliers/suppliers-create.spec.ts +148 -0
- package/integrations/ado-powershell/README.md +75 -0
- package/integrations/ado-powershell/pipelines/azure-pipeline-qa.yml +133 -0
- package/integrations/ado-powershell/scripts/create-testplan-from-mapping.ps1 +114 -0
- package/integrations/ado-powershell/scripts/inject-ado-ids.ps1 +96 -0
- package/integrations/ado-powershell/scripts/sync-ado-titles.ps1 +93 -0
- package/integrations/playwright/README.md +68 -0
- package/integrations/playwright-azure-reporter/README.md +88 -0
- package/package.json +57 -0
- package/qa-framework.config.json +87 -0
- package/scripts/cli.js +74 -0
- package/scripts/generate.js +92 -0
- package/scripts/init.js +322 -0
- package/scripts/validate.js +184 -0
- package/templates/automation-scaffold/.env.example +56 -0
- package/templates/automation-scaffold/fixtures/auth.ts +77 -0
- package/templates/automation-scaffold/fixtures/test-helpers.ts +85 -0
- package/templates/automation-scaffold/global-setup.ts +106 -0
- package/templates/automation-scaffold/package.json +24 -0
- package/templates/automation-scaffold/playwright.config.ts +85 -0
- package/templates/defect-report.md +101 -0
- package/templates/execution-report.md +116 -0
- package/templates/session-summary.md +73 -0
- package/templates/specification/00-inventory.md +81 -0
- package/templates/specification/01-business-rules.md +90 -0
- package/templates/specification/02-workflows.md +114 -0
- package/templates/specification/03-roles-permissions.md +49 -0
- package/templates/specification/04-test-data.md +104 -0
- package/templates/specification/05-test-scenarios.md +226 -0
- package/templates/test-case.md +81 -0
- package/templates/test-plan.md +130 -0
|
@@ -0,0 +1,130 @@
|
|
|
1
|
+
# Test Plan — {{MODULE_NAME}}
|
|
2
|
+
|
|
3
|
+
**Plan ID**: TP-{{MODULE}}-{{VERSION}}
|
|
4
|
+
**Module**: {{MODULE_NAME}}
|
|
5
|
+
**Sprint / Release**: Sprint {{NNN}}
|
|
6
|
+
**Prepared by**: (agent output — reviewed by human)
|
|
7
|
+
**Date**: YYYY-MM-DD
|
|
8
|
+
**ADO Test Plan**: #{ADO_PLAN_ID} (if ADO enabled)
|
|
9
|
+
|
|
10
|
+
---
|
|
11
|
+
|
|
12
|
+
## 1. Scope
|
|
13
|
+
|
|
14
|
+
### 1.1 In scope
|
|
15
|
+
|
|
16
|
+
| Submodule | Description | Automated? |
|
|
17
|
+
|-----------|-------------|------------|
|
|
18
|
+
| {{submodule}} | {{short description}} | Yes / No / Partial |
|
|
19
|
+
|
|
20
|
+
### 1.2 Out of scope
|
|
21
|
+
|
|
22
|
+
- {{reason and submodule/feature excluded}}
|
|
23
|
+
|
|
24
|
+
---
|
|
25
|
+
|
|
26
|
+
## 2. Test Objectives
|
|
27
|
+
|
|
28
|
+
1. Validate that all business rules defined in `01-business-rules.md` are met.
|
|
29
|
+
2. Confirm that all user roles interact with the UI as documented in `03-roles-permissions.md`.
|
|
30
|
+
3. Verify all happy-path workflows defined in `02-workflows.md` pass end-to-end.
|
|
31
|
+
4. Detect regressions against previously stable behaviour.
|
|
32
|
+
|
|
33
|
+
---
|
|
34
|
+
|
|
35
|
+
## 3. Entry & Exit Criteria
|
|
36
|
+
|
|
37
|
+
### Entry Criteria
|
|
38
|
+
|
|
39
|
+
- [ ] Feature is deployed to QA environment
|
|
40
|
+
- [ ] Database is seeded with required test data (see `04-test-data.md`)
|
|
41
|
+
- [ ] All P0 automated tests from previous sprint pass
|
|
42
|
+
- [ ] Defects critical to this plan are resolved (or explicitly waived)
|
|
43
|
+
|
|
44
|
+
### Exit Criteria
|
|
45
|
+
|
|
46
|
+
- [ ] All P0 test cases pass
|
|
47
|
+
- [ ] ≥80% of P1 test cases pass
|
|
48
|
+
- [ ] No open Critical/High severity defects without accepted workaround
|
|
49
|
+
- [ ] Execution report delivered and signed off
|
|
50
|
+
|
|
51
|
+
---
|
|
52
|
+
|
|
53
|
+
## 4. Test Case Inventory
|
|
54
|
+
|
|
55
|
+
| TC-ID | Title | Priority | Type | Automated | Spec source |
|
|
56
|
+
|-------|-------|----------|------|-----------|-------------|
|
|
57
|
+
| TC-{{M}}-{{S}}-001 | {{title}} | P0 | Functional | Yes | `05-test-scenarios.md` |
|
|
58
|
+
| TC-{{M}}-{{S}}-002 | {{title}} | P1 | Functional | No | `05-test-scenarios.md` |
|
|
59
|
+
|
|
60
|
+
**Summary**:
|
|
61
|
+
- Total TCs: {{N}}
|
|
62
|
+
- P0: {{N}} | P1: {{N}} | P2: {{N}} | P3: {{N}}
|
|
63
|
+
- Automated: {{N}} | Manual: {{N}}
|
|
64
|
+
|
|
65
|
+
---
|
|
66
|
+
|
|
67
|
+
## 5. Automation Feasibility
|
|
68
|
+
|
|
69
|
+
| Scenario | Feasible? | Reason if not |
|
|
70
|
+
|----------|-----------|---------------|
|
|
71
|
+
| Happy path create | Yes | — |
|
|
72
|
+
| Export to PDF | No | Requires visual validation |
|
|
73
|
+
| Third-party OAuth | No | External system |
|
|
74
|
+
|
|
75
|
+
**Automation target for this plan**: {{N}} automated specs / {{N}} total automated steps
|
|
76
|
+
|
|
77
|
+
---
|
|
78
|
+
|
|
79
|
+
## 6. Risk Assessment
|
|
80
|
+
|
|
81
|
+
| Risk | Likelihood | Impact | Mitigation |
|
|
82
|
+
|------|-----------|--------|------------|
|
|
83
|
+
| QA env unstable | Medium | High | Re-run suite; notify DevOps |
|
|
84
|
+
| Test data collision | Low | Medium | Use EXEC_IDX pattern |
|
|
85
|
+
| ADO sync failure | Low | Low | Sync manually via inject script |
|
|
86
|
+
|
|
87
|
+
---
|
|
88
|
+
|
|
89
|
+
## 7. Schedule
|
|
90
|
+
|
|
91
|
+
| Activity | Owner | Target date |
|
|
92
|
+
|----------|-------|-------------|
|
|
93
|
+
| Spec review | QA Lead | YYYY-MM-DD |
|
|
94
|
+
| Manual execution | QA Analyst | YYYY-MM-DD |
|
|
95
|
+
| Automation run | Agent / CI | YYYY-MM-DD |
|
|
96
|
+
| Sign-off | PM / Tech Lead | YYYY-MM-DD |
|
|
97
|
+
|
|
98
|
+
---
|
|
99
|
+
|
|
100
|
+
## 8. Dependencies
|
|
101
|
+
|
|
102
|
+
- Environment: `{{QA_BASE_URL}}`
|
|
103
|
+
- Test users: see `04-test-data.md §Prerequisites`
|
|
104
|
+
- Services: {{list any external APIs or integrations required}}
|
|
105
|
+
|
|
106
|
+
---
|
|
107
|
+
|
|
108
|
+
## 9. Defects from Previous Cycle
|
|
109
|
+
|
|
110
|
+
| DEF-ID | Title | Status | Impact on this plan |
|
|
111
|
+
|--------|-------|--------|---------------------|
|
|
112
|
+
| DEF-001 | {{title}} | Open | TC-{{M}}-{{S}}-{{NNN}} remains skipped |
|
|
113
|
+
|
|
114
|
+
---
|
|
115
|
+
|
|
116
|
+
## 10. Approval
|
|
117
|
+
|
|
118
|
+
| Role | Name | Date | Signature |
|
|
119
|
+
|------|------|------|-----------|
|
|
120
|
+
| QA Lead | | | |
|
|
121
|
+
| Tech Lead | | | |
|
|
122
|
+
| Product Owner | | | |
|
|
123
|
+
|
|
124
|
+
---
|
|
125
|
+
|
|
126
|
+
## Changelog
|
|
127
|
+
|
|
128
|
+
| Version | Date | Description |
|
|
129
|
+
|---------|------|-------------|
|
|
130
|
+
| 1.0 | YYYY-MM-DD | Initial plan created |
|