qa-skills 3.0.0 → 3.1.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (262) hide show
  1. package/README.md +20 -149
  2. package/bin/cli.js +1 -40
  3. package/package.json +23 -26
  4. package/dist/agents/registry.d.ts +0 -5
  5. package/dist/agents/registry.d.ts.map +0 -1
  6. package/dist/agents/registry.js +0 -101
  7. package/dist/agents/registry.js.map +0 -1
  8. package/dist/agents/types.d.ts +0 -9
  9. package/dist/agents/types.d.ts.map +0 -1
  10. package/dist/agents/types.js +0 -2
  11. package/dist/agents/types.js.map +0 -1
  12. package/dist/dependencies.d.ts +0 -21
  13. package/dist/dependencies.d.ts.map +0 -1
  14. package/dist/dependencies.js +0 -125
  15. package/dist/dependencies.js.map +0 -1
  16. package/dist/installer.d.ts +0 -25
  17. package/dist/installer.d.ts.map +0 -1
  18. package/dist/installer.js +0 -437
  19. package/dist/installer.js.map +0 -1
  20. package/dist/scaffold.d.ts +0 -27
  21. package/dist/scaffold.d.ts.map +0 -1
  22. package/dist/scaffold.js +0 -182
  23. package/dist/scaffold.js.map +0 -1
  24. package/skills/qa-accessibility-test-writer/SKILL.md +0 -127
  25. package/skills/qa-accessibility-test-writer/references/axe-core-patterns.md +0 -349
  26. package/skills/qa-accessibility-test-writer/references/best-practices.md +0 -184
  27. package/skills/qa-accessibility-test-writer/references/wcag-tests.md +0 -331
  28. package/skills/qa-api-contract-curator/SKILL.md +0 -104
  29. package/skills/qa-api-contract-curator/references/breaking-changes.md +0 -363
  30. package/skills/qa-api-contract-curator/references/openapi-structure.md +0 -404
  31. package/skills/qa-browser-data-collector/SKILL.md +0 -132
  32. package/skills/qa-browser-data-collector/references/data-collection-checklist.md +0 -91
  33. package/skills/qa-browser-data-collector/references/playwright-mcp-patterns.md +0 -113
  34. package/skills/qa-bug-ticket-creator/SKILL.md +0 -148
  35. package/skills/qa-bug-ticket-creator/references/bug-report-format.md +0 -149
  36. package/skills/qa-bug-ticket-creator/references/severity-guide.md +0 -81
  37. package/skills/qa-bug-ticket-creator/templates/bug-ticket-template.md +0 -39
  38. package/skills/qa-changelog-analyzer/SKILL.md +0 -134
  39. package/skills/qa-changelog-analyzer/references/git-analysis-patterns.md +0 -138
  40. package/skills/qa-changelog-analyzer/references/impact-mapping.md +0 -120
  41. package/skills/qa-clickup-integration/SKILL.md +0 -166
  42. package/skills/qa-clickup-integration/references/api-patterns.md +0 -102
  43. package/skills/qa-clickup-integration/references/field-mapping.md +0 -71
  44. package/skills/qa-codeceptjs-writer/SKILL.md +0 -136
  45. package/skills/qa-codeceptjs-writer/references/best-practices.md +0 -207
  46. package/skills/qa-codeceptjs-writer/references/config.md +0 -255
  47. package/skills/qa-codeceptjs-writer/references/patterns.md +0 -285
  48. package/skills/qa-coverage-analyzer/SKILL.md +0 -166
  49. package/skills/qa-coverage-analyzer/references/best-practices.md +0 -142
  50. package/skills/qa-coverage-analyzer/references/coverage-dimensions.md +0 -155
  51. package/skills/qa-coverage-analyzer/references/tools.md +0 -204
  52. package/skills/qa-cypress-writer/SKILL.md +0 -134
  53. package/skills/qa-cypress-writer/references/assertions.md +0 -121
  54. package/skills/qa-cypress-writer/references/best-practices.md +0 -82
  55. package/skills/qa-cypress-writer/references/config.md +0 -121
  56. package/skills/qa-cypress-writer/references/patterns.md +0 -170
  57. package/skills/qa-data-factory/SKILL.md +0 -126
  58. package/skills/qa-data-factory/references/factory-patterns.md +0 -164
  59. package/skills/qa-data-factory/references/faker-guide.md +0 -131
  60. package/skills/qa-diagram-generator/SKILL.md +0 -125
  61. package/skills/qa-diagram-generator/references/c4-model.md +0 -53
  62. package/skills/qa-diagram-generator/references/charts.md +0 -58
  63. package/skills/qa-diagram-generator/references/class-diagram.md +0 -85
  64. package/skills/qa-diagram-generator/references/er-diagram.md +0 -69
  65. package/skills/qa-diagram-generator/references/flowchart.md +0 -92
  66. package/skills/qa-diagram-generator/references/from-screenshot.md +0 -45
  67. package/skills/qa-diagram-generator/references/gantt.md +0 -49
  68. package/skills/qa-diagram-generator/references/journey.md +0 -50
  69. package/skills/qa-diagram-generator/references/mindmap.md +0 -75
  70. package/skills/qa-diagram-generator/references/sequence.md +0 -69
  71. package/skills/qa-diagram-generator/references/state-diagram.md +0 -56
  72. package/skills/qa-discovery-interview/SKILL.md +0 -182
  73. package/skills/qa-discovery-interview/references/completeness-checklist.md +0 -53
  74. package/skills/qa-discovery-interview/references/conflict-patterns.md +0 -101
  75. package/skills/qa-discovery-interview/references/qa-categories.md +0 -147
  76. package/skills/qa-discovery-interview/templates/qa-brief-template.md +0 -168
  77. package/skills/qa-environment-checker/SKILL.md +0 -142
  78. package/skills/qa-environment-checker/references/dependency-matrix.md +0 -101
  79. package/skills/qa-environment-checker/references/health-checks.md +0 -209
  80. package/skills/qa-environment-checker/templates/env-readiness-template.md +0 -64
  81. package/skills/qa-flaky-detector/SKILL.md +0 -153
  82. package/skills/qa-flaky-detector/references/ci-analysis.md +0 -140
  83. package/skills/qa-flaky-detector/references/flaky-patterns.md +0 -247
  84. package/skills/qa-github-issues-enhanced/SKILL.md +0 -175
  85. package/skills/qa-github-issues-enhanced/references/issue-templates.md +0 -425
  86. package/skills/qa-github-issues-enhanced/references/label-taxonomy.md +0 -130
  87. package/skills/qa-github-issues-enhanced/references/workflow-patterns.md +0 -188
  88. package/skills/qa-httpx-writer/SKILL.md +0 -138
  89. package/skills/qa-httpx-writer/references/assertions.md +0 -195
  90. package/skills/qa-httpx-writer/references/best-practices.md +0 -140
  91. package/skills/qa-httpx-writer/references/config.md +0 -212
  92. package/skills/qa-httpx-writer/references/patterns.md +0 -262
  93. package/skills/qa-jest-writer/SKILL.md +0 -131
  94. package/skills/qa-jest-writer/references/assertions.md +0 -125
  95. package/skills/qa-jest-writer/references/best-practices.md +0 -136
  96. package/skills/qa-jest-writer/references/config.md +0 -134
  97. package/skills/qa-jest-writer/references/patterns.md +0 -172
  98. package/skills/qa-jira-integration/SKILL.md +0 -135
  99. package/skills/qa-jira-integration/references/api-patterns.md +0 -143
  100. package/skills/qa-jira-integration/references/field-mapping.md +0 -79
  101. package/skills/qa-jira-integration/references/xray-integration.md +0 -85
  102. package/skills/qa-jmeter-writer/SKILL.md +0 -171
  103. package/skills/qa-jmeter-writer/references/best-practices.md +0 -157
  104. package/skills/qa-jmeter-writer/references/config.md +0 -204
  105. package/skills/qa-jmeter-writer/references/patterns.md +0 -242
  106. package/skills/qa-junit5-writer/SKILL.md +0 -157
  107. package/skills/qa-junit5-writer/references/assertions.md +0 -118
  108. package/skills/qa-junit5-writer/references/config.md +0 -97
  109. package/skills/qa-junit5-writer/references/patterns.md +0 -162
  110. package/skills/qa-k6-writer/SKILL.md +0 -155
  111. package/skills/qa-k6-writer/references/best-practices.md +0 -236
  112. package/skills/qa-k6-writer/references/config.md +0 -219
  113. package/skills/qa-k6-writer/references/patterns.md +0 -304
  114. package/skills/qa-linear-integration/SKILL.md +0 -137
  115. package/skills/qa-linear-integration/references/api-patterns.md +0 -249
  116. package/skills/qa-linear-integration/references/field-mapping.md +0 -121
  117. package/skills/qa-locust-writer/SKILL.md +0 -151
  118. package/skills/qa-locust-writer/references/best-practices.md +0 -126
  119. package/skills/qa-locust-writer/references/config.md +0 -170
  120. package/skills/qa-locust-writer/references/patterns.md +0 -235
  121. package/skills/qa-manual-test-designer/SKILL.md +0 -145
  122. package/skills/qa-manual-test-designer/references/exploratory-charters.md +0 -138
  123. package/skills/qa-manual-test-designer/references/personas.md +0 -146
  124. package/skills/qa-manual-test-designer/templates/exploratory-charter-template.md +0 -47
  125. package/skills/qa-manual-test-designer/templates/test-case-template.md +0 -31
  126. package/skills/qa-mobile-test-writer/SKILL.md +0 -144
  127. package/skills/qa-mobile-test-writer/references/best-practices.md +0 -214
  128. package/skills/qa-mobile-test-writer/references/config.md +0 -309
  129. package/skills/qa-mobile-test-writer/references/patterns.md +0 -304
  130. package/skills/qa-nfr-analyst/SKILL.md +0 -177
  131. package/skills/qa-nfr-analyst/references/iso-25010-model.md +0 -159
  132. package/skills/qa-nfr-analyst/references/owasp-wstg-baseline.md +0 -202
  133. package/skills/qa-nfr-analyst/references/wcag-checklist.md +0 -184
  134. package/skills/qa-nfr-analyst/templates/owasp-checklist-template.md +0 -89
  135. package/skills/qa-nfr-analyst/templates/wcag-checklist-template.md +0 -48
  136. package/skills/qa-orchestrator/SKILL.md +0 -132
  137. package/skills/qa-orchestrator/references/handoff-chains.md +0 -105
  138. package/skills/qa-orchestrator/references/pipeline-modes.md +0 -115
  139. package/skills/qa-orchestrator/references/scheduler-rules.md +0 -84
  140. package/skills/qa-pact-writer/SKILL.md +0 -133
  141. package/skills/qa-pact-writer/references/best-practices.md +0 -100
  142. package/skills/qa-pact-writer/references/config.md +0 -135
  143. package/skills/qa-pact-writer/references/patterns.md +0 -161
  144. package/skills/qa-plan-creator/SKILL.md +0 -139
  145. package/skills/qa-plan-creator/references/introduction-plan.md +0 -43
  146. package/skills/qa-plan-creator/references/migration-plan.md +0 -44
  147. package/skills/qa-plan-creator/references/onboarding-plan.md +0 -46
  148. package/skills/qa-plan-creator/references/performance-plan.md +0 -44
  149. package/skills/qa-plan-creator/references/regression-plan.md +0 -45
  150. package/skills/qa-plan-creator/references/release-plan.md +0 -45
  151. package/skills/qa-plan-creator/references/sprint-plan.md +0 -44
  152. package/skills/qa-plan-creator/references/test-plan.md +0 -59
  153. package/skills/qa-plan-creator/references/uat-plan.md +0 -43
  154. package/skills/qa-plan-creator/templates/checklist-template.md +0 -36
  155. package/skills/qa-plan-creator/templates/regression-checklist-template.md +0 -49
  156. package/skills/qa-plan-creator/templates/release-checklist-template.md +0 -46
  157. package/skills/qa-plan-creator/templates/test-plan-template.md +0 -74
  158. package/skills/qa-playwright-py-writer/SKILL.md +0 -156
  159. package/skills/qa-playwright-py-writer/references/best-practices.md +0 -194
  160. package/skills/qa-playwright-py-writer/references/config.md +0 -195
  161. package/skills/qa-playwright-py-writer/references/patterns.md +0 -212
  162. package/skills/qa-playwright-ts-writer/SKILL.md +0 -151
  163. package/skills/qa-playwright-ts-writer/references/assertions.md +0 -109
  164. package/skills/qa-playwright-ts-writer/references/best-practices.md +0 -191
  165. package/skills/qa-playwright-ts-writer/references/config.md +0 -144
  166. package/skills/qa-playwright-ts-writer/references/patterns.md +0 -171
  167. package/skills/qa-pytest-writer/SKILL.md +0 -145
  168. package/skills/qa-pytest-writer/references/assertions.md +0 -149
  169. package/skills/qa-pytest-writer/references/best-practices.md +0 -97
  170. package/skills/qa-pytest-writer/references/config.md +0 -176
  171. package/skills/qa-pytest-writer/references/patterns.md +0 -251
  172. package/skills/qa-qase-integration/SKILL.md +0 -149
  173. package/skills/qa-qase-integration/references/api-reference.md +0 -354
  174. package/skills/qa-qase-integration/references/ci-integration.md +0 -196
  175. package/skills/qa-qase-integration/references/field-mapping.md +0 -157
  176. package/skills/qa-requirements-generator/SKILL.md +0 -152
  177. package/skills/qa-requirements-generator/references/iso-29148-structure.md +0 -153
  178. package/skills/qa-requirements-generator/references/requirement-patterns.md +0 -278
  179. package/skills/qa-rest-assured-writer/SKILL.md +0 -137
  180. package/skills/qa-rest-assured-writer/references/best-practices.md +0 -50
  181. package/skills/qa-rest-assured-writer/references/config.md +0 -124
  182. package/skills/qa-rest-assured-writer/references/patterns.md +0 -192
  183. package/skills/qa-risk-analyzer/SKILL.md +0 -158
  184. package/skills/qa-risk-analyzer/references/impact-analysis.md +0 -133
  185. package/skills/qa-risk-analyzer/references/risk-factors.md +0 -123
  186. package/skills/qa-robot-framework-writer/SKILL.md +0 -147
  187. package/skills/qa-robot-framework-writer/references/best-practices.md +0 -249
  188. package/skills/qa-robot-framework-writer/references/config.md +0 -204
  189. package/skills/qa-robot-framework-writer/references/libraries.md +0 -273
  190. package/skills/qa-robot-framework-writer/references/patterns.md +0 -216
  191. package/skills/qa-security-test-writer/SKILL.md +0 -123
  192. package/skills/qa-security-test-writer/references/best-practices.md +0 -155
  193. package/skills/qa-security-test-writer/references/owasp-top10.md +0 -331
  194. package/skills/qa-security-test-writer/references/zap-config.md +0 -258
  195. package/skills/qa-selenium-java-writer/SKILL.md +0 -143
  196. package/skills/qa-selenium-java-writer/references/best-practices.md +0 -59
  197. package/skills/qa-selenium-java-writer/references/config.md +0 -143
  198. package/skills/qa-selenium-java-writer/references/patterns.md +0 -170
  199. package/skills/qa-selenium-py-writer/SKILL.md +0 -150
  200. package/skills/qa-selenium-py-writer/references/best-practices.md +0 -175
  201. package/skills/qa-selenium-py-writer/references/config.md +0 -224
  202. package/skills/qa-selenium-py-writer/references/patterns.md +0 -255
  203. package/skills/qa-shortcut-integration/SKILL.md +0 -143
  204. package/skills/qa-shortcut-integration/references/api-patterns.md +0 -126
  205. package/skills/qa-shortcut-integration/references/field-mapping.md +0 -66
  206. package/skills/qa-spec-auditor/SKILL.md +0 -162
  207. package/skills/qa-spec-auditor/references/audit-checklist.md +0 -144
  208. package/skills/qa-spec-auditor/references/drift-patterns.md +0 -207
  209. package/skills/qa-spec-writer/SKILL.md +0 -143
  210. package/skills/qa-spec-writer/references/gherkin-guide.md +0 -253
  211. package/skills/qa-spec-writer/references/specification-patterns.md +0 -274
  212. package/skills/qa-spring-test-writer/SKILL.md +0 -170
  213. package/skills/qa-spring-test-writer/references/best-practices.md +0 -57
  214. package/skills/qa-spring-test-writer/references/config.md +0 -179
  215. package/skills/qa-spring-test-writer/references/patterns.md +0 -235
  216. package/skills/qa-supertest-writer/SKILL.md +0 -150
  217. package/skills/qa-supertest-writer/references/assertions.md +0 -192
  218. package/skills/qa-supertest-writer/references/best-practices.md +0 -102
  219. package/skills/qa-supertest-writer/references/config.md +0 -166
  220. package/skills/qa-supertest-writer/references/patterns.md +0 -242
  221. package/skills/qa-task-creator/SKILL.md +0 -142
  222. package/skills/qa-task-creator/references/linking-patterns.md +0 -127
  223. package/skills/qa-task-creator/references/task-types.md +0 -169
  224. package/skills/qa-task-creator/templates/task-template.md +0 -24
  225. package/skills/qa-test-doc-compiler/SKILL.md +0 -114
  226. package/skills/qa-test-doc-compiler/references/agile-tailoring.md +0 -220
  227. package/skills/qa-test-doc-compiler/references/iso-29119-3-documents.md +0 -302
  228. package/skills/qa-test-healer/SKILL.md +0 -101
  229. package/skills/qa-test-healer/references/diagnosis-patterns.md +0 -142
  230. package/skills/qa-test-healer/references/fix-strategies.md +0 -177
  231. package/skills/qa-test-reporter/SKILL.md +0 -130
  232. package/skills/qa-test-reporter/references/best-practices.md +0 -162
  233. package/skills/qa-test-reporter/references/iso-29119-reports.md +0 -236
  234. package/skills/qa-test-reporter/references/report-formats.md +0 -287
  235. package/skills/qa-test-reviewer/SKILL.md +0 -142
  236. package/skills/qa-test-reviewer/references/anti-patterns.md +0 -268
  237. package/skills/qa-test-reviewer/references/review-checklist.md +0 -93
  238. package/skills/qa-test-strategy/SKILL.md +0 -133
  239. package/skills/qa-test-strategy/references/entry-exit-criteria.md +0 -176
  240. package/skills/qa-test-strategy/references/risk-matrix.md +0 -102
  241. package/skills/qa-test-strategy/references/testing-types.md +0 -143
  242. package/skills/qa-testcase-from-docs/SKILL.md +0 -161
  243. package/skills/qa-testcase-from-docs/references/test-case-format.md +0 -196
  244. package/skills/qa-testcase-from-docs/references/test-design-techniques.md +0 -126
  245. package/skills/qa-testcase-from-docs/templates/test-case-template.md +0 -31
  246. package/skills/qa-testcase-from-ui/SKILL.md +0 -109
  247. package/skills/qa-testcase-from-ui/references/ui-element-patterns.md +0 -126
  248. package/skills/qa-testcase-from-ui/references/visual-analysis-guide.md +0 -146
  249. package/skills/qa-testcase-from-ui/templates/test-case-template.md +0 -31
  250. package/skills/qa-visual-regression-writer/SKILL.md +0 -175
  251. package/skills/qa-visual-regression-writer/references/best-practices.md +0 -154
  252. package/skills/qa-visual-regression-writer/references/config.md +0 -220
  253. package/skills/qa-visual-regression-writer/references/patterns.md +0 -213
  254. package/skills/qa-vitest-writer/SKILL.md +0 -141
  255. package/skills/qa-vitest-writer/references/assertions.md +0 -105
  256. package/skills/qa-vitest-writer/references/best-practices.md +0 -62
  257. package/skills/qa-vitest-writer/references/config.md +0 -127
  258. package/skills/qa-vitest-writer/references/patterns.md +0 -141
  259. package/skills/qa-webdriverio-writer/SKILL.md +0 -145
  260. package/skills/qa-webdriverio-writer/references/best-practices.md +0 -176
  261. package/skills/qa-webdriverio-writer/references/config.md +0 -240
  262. package/skills/qa-webdriverio-writer/references/patterns.md +0 -269
@@ -1,114 +0,0 @@
1
- ---
2
- name: qa-test-doc-compiler
3
- description: Compile formal test documentation per ISO/IEC/IEEE 29119-3 including test policies, plans, specifications, execution logs, incident reports, and completion reports.
4
- output_dir: docs/compiled
5
- dependencies:
6
- recommended:
7
- - qa-test-reporter
8
- ---
9
-
10
- # QA Test Doc Compiler
11
-
12
- ## Purpose
13
-
14
- Compile formal test documentation per ISO/IEC/IEEE 29119-3. Collect inputs from other QA skills, organize content per ISO structure, format documents, and validate completeness. Supports tailoring for Agile, Scrum, and DevOps contexts.
15
-
16
- ## Document Types
17
-
18
- | Category | Document Types |
19
- | -------- | -------------- |
20
- | **Governance** | Test Policy, Organizational Test Practices |
21
- | **Planning** | Project Test Plan, Level Test Plans (unit/integration/system/acceptance), Type Test Plans (functional/performance/security) |
22
- | **Specification** | Test Model Specification, Test Case Specification, Test Procedure Specification |
23
- | **Execution** | Test Execution Log, Test Incident Report |
24
- | **Reporting** | Test Status Report, Test Completion Report |
25
- | **Readiness** | Test Data Requirements, Test Environment Requirements, Test Data Readiness Report, Test Environment Readiness Report |
26
-
27
- See `references/iso-29119-3-documents.md` for required sections per document type.
28
-
29
- ## Document Compilation Workflow
30
-
31
- 1. **Collect inputs** — Gather content from other skills:
32
- - `qa-requirements-generator` → requirements, acceptance criteria
33
- - `qa-plan-creator` → test plans, sprint plans, release plans
34
- - `qa-spec-writer` → specifications, acceptance criteria
35
- - `qa-testcase-from-docs` → test cases, RTM
36
- - `qa-nfr-analyst` → NFR criteria for performance/security plans
37
- - Manual inputs: execution logs, incident reports, status updates
38
-
39
- 2. **Organize per ISO structure** — Map content to ISO 29119-3 document templates. Use `references/iso-29119-3-documents.md` for mandatory/recommended sections.
40
-
41
- 3. **Format** — Apply consistent formatting (Markdown, tables, traceability IDs). Call `qa-diagram-generator` for Gantt charts, flowcharts, or RTM visualizations when needed.
42
-
43
- 4. **Validate completeness** — Check:
44
- - All mandatory sections present
45
- - Traceability links preserved (requirement → test model → test case → procedure)
46
- - IDs follow project conventions
47
- - No orphaned references
48
-
49
- 5. **Tailor for context** — If Agile/DevOps, apply `references/agile-tailoring.md` to reduce ceremony and merge documents where appropriate.
50
-
51
- ## Trigger Phrases
52
-
53
- - "Compile test documentation per ISO 29119-3"
54
- - "Create test policy / organizational test practices"
55
- - "Assemble test plan from [sources]"
56
- - "Format test execution log / incident report"
57
- - "Generate test completion report"
58
- - "Tailor ISO 29119-3 for Agile/DevOps"
59
-
60
- ## Scope
61
-
62
- **Can do (autonomous):**
63
- - Compile any ISO 29119-3 document type from provided inputs
64
- - Organize content into ISO structure
65
- - Merge outputs from multiple QA skills into coherent documents
66
- - Apply Agile/DevOps tailoring per reference guide
67
- - Call qa-diagram-generator for timelines, RTM, flowcharts
68
- - Validate mandatory sections and traceability
69
-
70
- **Cannot do (requires confirmation):**
71
- - Create content from scratch without inputs (policy, practices, plans need stakeholder input)
72
- - Override organizational test policy or practices
73
- - Change scope or priorities set by stakeholders
74
-
75
- **Will not do (out of scope):**
76
- - Execute tests or automation
77
- - Modify production code or environments
78
- - Approve documents (approval is stakeholder responsibility)
79
- - Generate test code
80
-
81
- ## Embedding: Diagram Generator
82
-
83
- When visualization is needed, reference qa-diagram-generator:
84
- - **Timelines** → `references/gantt.md`
85
- - **Traceability** → `references/flowchart.md` or mindmap
86
- - **Test flow** → `references/sequence.md`
87
-
88
- ## Quality Checklist
89
-
90
- - [ ] Document type matches ISO 29119-3 definition
91
- - [ ] All mandatory sections present per `references/iso-29119-3-documents.md`
92
- - [ ] Traceability links preserved (REQ → model → case → procedure)
93
- - [ ] IDs follow project conventions (e.g., TC-001, TIR-001)
94
- - [ ] Agile tailoring applied when context is Agile/DevOps
95
- - [ ] No hardcoded secrets or sensitive data
96
- - [ ] Format consistent (Markdown, tables, headings)
97
-
98
- ## Troubleshooting
99
-
100
- | Symptom | Likely Cause | Fix |
101
- | ------- | ------------ | --- |
102
- | Missing mandatory sections | Inputs incomplete or wrong document type | Check `references/iso-29119-3-documents.md`; request missing inputs |
103
- | Broken traceability links | IDs changed or content merged incorrectly | Re-map requirement → test case links; validate RTM |
104
- | Document too heavy for Agile | Full ISO structure applied | Apply `references/agile-tailoring.md`; merge/omit non-essential sections |
105
- | Inconsistent formatting | Multiple sources with different styles | Normalize to single template; use consistent ID prefixes |
106
- | Orphaned references | Deleted or renamed items | Audit references; update or remove broken links |
107
- | Policy conflicts with plan | Stakeholder input contradicts | Flag for resolution; do not override policy |
108
-
109
- ## Reference Files
110
-
111
- | Topic | File |
112
- | ----- | ---- |
113
- | ISO 29119-3 document types & sections | `references/iso-29119-3-documents.md` |
114
- | Agile/Scrum/DevOps tailoring | `references/agile-tailoring.md` |
@@ -1,220 +0,0 @@
1
- # Agile/Scrum/DevOps Tailoring Guide for ISO 29119-3
2
-
3
- *How to adapt ISO/IEC/IEEE 29119-3 test documentation for Agile, Scrum, and DevOps contexts while preserving traceability and compliance.*
4
-
5
- ## Principles
6
-
7
- 1. **Reduce ceremony, not traceability** — Merge documents, shorten cycles, but keep requirement → test case links.
8
- 2. **Living documents** — Confluence pages, wiki, or repo Markdown instead of static PDFs.
9
- 3. **Automation-friendly** — Structure for tool integration (Jira, Zephyr, TestRail, Allure).
10
- 4. **Just enough** — Include only what adds value for the team and stakeholders.
11
-
12
- ---
13
-
14
- ## Document Merging Strategies
15
-
16
- ### Option A: Minimal Set (Sprint-based)
17
-
18
- | ISO Document | Agile Equivalent |
19
- |--------------|------------------|
20
- | Test Policy | Org-level; rarely changes; 1-page summary |
21
- | Organizational Test Practices | Definition of Done, DoD for testing; wiki page |
22
- | Project Test Plan | Release/sprint 0 doc; high-level only |
23
- | Level/Type Test Plans | Merged into single "Test Approach" section |
24
- | Test Model Specification | Inline in test case or BDD feature file |
25
- | Test Case Specification | Jira/Zephyr/TestRail; or Markdown in repo |
26
- | Test Procedure Specification | Steps in test case; or automated (code = procedure) |
27
- | Test Execution Log | CI/CD results; JUnit/Allure/TestRail |
28
- | Test Incident Report | Bug ticket (Jira, GitHub Issues) |
29
- | Test Status Report | Sprint burndown, dashboard, standup notes |
30
- | Test Completion Report | Release retrospective; 1-page summary |
31
- | Test Data/Environment Requirements | README or runbook; as-needed |
32
- | Readiness Reports | Checklist in Confluence; or omitted if self-evident |
33
-
34
- ### Option B: Hybrid (Regulated / Contract)
35
-
36
- Keep formal documents for audit, but:
37
- - Use templates; auto-populate from tools where possible
38
- - Generate Test Completion Report from CI + bug tracker
39
- - Keep Test Policy and Organizational Test Practices as living docs, reviewed quarterly
40
-
41
- ### Option C: DevOps / Continuous Delivery
42
-
43
- - **Test Plan** → Pipeline config, quality gates, deployment criteria
44
- - **Test Case** → Automated test code + BDD scenarios
45
- - **Execution Log** → CI logs, Allure/JUnit XML
46
- - **Incident Report** → Bug ticket linked to failing test
47
- - **Status/Completion** → Dashboard (Grafana, custom); no separate report unless requested
48
-
49
- ---
50
-
51
- ## Tailoring by Document Type
52
-
53
- ### Test Policy
54
-
55
- | Full ISO | Agile Tailoring |
56
- |----------|------------------|
57
- | Multi-page policy | 1-page summary: objectives, principles, governance |
58
- | Formal approval cycle | Living doc; reviewed at org retro |
59
- | Detailed roles | Link to RACI; keep high-level only |
60
-
61
- ### Organizational Test Practices
62
-
63
- | Full ISO | Agile Tailoring |
64
- |----------|------------------|
65
- | Separate document | Merge into "Testing" section of team wiki |
66
- | Detailed process | Definition of Done for testing; Definition of Ready |
67
- | Tool strategy | Tool section; link to pipeline docs |
68
-
69
- ### Project Test Plan
70
-
71
- | Full ISO | Agile Tailoring |
72
- |----------|------------------|
73
- | Full 13-section plan | Release/sprint 0: scope, approach, entry/exit, risks |
74
- | Level + Type plans | Single "Test Approach" table: level × type × tools |
75
- | Formal approvals | Async sign-off; or Product Owner acceptance |
76
-
77
- ### Test Model Specification
78
-
79
- | Full ISO | Agile Tailoring |
80
- |----------|------------------|
81
- | Standalone document | Inline in BDD feature (Given/When/Then) or test case |
82
- | Formal traceability | Link in test case to requirement ID |
83
- | Diagrams | Use qa-diagram-generator; embed in Confluence |
84
-
85
- ### Test Case Specification
86
-
87
- | Full ISO | Agile Tailoring |
88
- |----------|------------------|
89
- | Formal document | Test management tool (Zephyr, TestRail) or Markdown table |
90
- | Full preconditions | Condensed; link to setup docs |
91
- | Traceability | Requirement ID in test case; RTM auto-generated |
92
-
93
- ### Test Procedure Specification
94
-
95
- | Full ISO | Agile Tailoring |
96
- |----------|------------------|
97
- | Separate procedure doc | Steps in test case; or automated test = procedure |
98
- | Manual procedures | Keep for manual/exploratory; automate where possible |
99
-
100
- ### Test Execution Log
101
-
102
- | Full ISO | Agile Tailoring |
103
- |----------|------------------|
104
- | Manual log | CI/CD results; JUnit XML, Allure, TestRail |
105
- | Per-execution record | Pipeline run = execution; link build to test results |
106
- | Manual tests | Log in tool; or lightweight spreadsheet |
107
-
108
- ### Test Incident Report
109
-
110
- | Full ISO | Agile Tailoring |
111
- |----------|------------------|
112
- | Formal TIR template | Bug ticket (Jira, GitHub Issues) with: expected, actual, steps, severity |
113
- | Separate numbering | Use ticket ID (e.g., PROJ-123) |
114
- | Traceability | Link bug to test case ID |
115
-
116
- ### Test Status Report
117
-
118
- | Full ISO | Agile Tailoring |
119
- |----------|------------------|
120
- | Periodic report | Sprint burndown, dashboard, standup summary |
121
- | Formal document | Omit; or 1-page sprint test summary if stakeholder needs |
122
- | Metrics | Coverage %, pass rate, open bugs; auto from tools |
123
-
124
- ### Test Completion Report
125
-
126
- | Full ISO | Agile Tailoring |
127
- |----------|------------------|
128
- | Formal report | Release retrospective; 1-page: summary, exit criteria met, recommendations |
129
- | Full metrics | Link to dashboard; summarize key numbers |
130
- | Lessons learned | Part of retro; optional section |
131
-
132
- ### Test Data / Environment Requirements
133
-
134
- | Full ISO | Agile Tailoring |
135
- |----------|------------------|
136
- | Formal document | README, runbook, or Confluence page |
137
- | Readiness reports | Checklist; or omit if team self-manages |
138
- | Traceability | Link from test plan or wiki |
139
-
140
- ---
141
-
142
- ## Scrum-Specific Patterns
143
-
144
- ### Sprint Cycle
145
-
146
- | Phase | Documents |
147
- |-------|-----------|
148
- | **Sprint Planning** | Sprint Test Plan (lightweight) or Test Approach in sprint goal |
149
- | **Development** | Test cases in backlog; BDD scenarios in code |
150
- | **Daily** | No formal doc; standup covers blockers |
151
- | **Sprint Review** | Demo = informal execution; bugs logged |
152
- | **Sprint Retro** | Update Organizational Test Practices if needed |
153
- | **Release** | Test Completion Report (1-page) if release sign-off required |
154
-
155
- ### Definition of Done (Testing)
156
-
157
- Include in DoD:
158
- - [ ] Test cases written for new/changed features
159
- - [ ] Automated tests in pipeline where applicable
160
- - [ ] No critical/high bugs open for release scope
161
- - [ ] Test execution logged (CI or manual log)
162
- - [ ] Traceability: requirement → test case
163
-
164
- ### Definition of Ready (Testing)
165
-
166
- - [ ] Acceptance criteria defined
167
- - [ ] Test environment available
168
- - [ ] Test data identified
169
- - [ ] Dependencies known
170
-
171
- ---
172
-
173
- ## DevOps-Specific Patterns
174
-
175
- ### Pipeline as Documentation
176
-
177
- - **Test Plan** → Quality gates in pipeline (e.g., 80% pass, no critical failures)
178
- - **Test Procedure** → Test code
179
- - **Execution Log** → CI run logs, Allure report
180
- - **Incident Report** → Bug created from failed test; auto-link
181
-
182
- ### Quality Gates
183
-
184
- Define in pipeline config:
185
- - Unit test pass rate
186
- - Integration test pass rate
187
- - Coverage threshold
188
- - Security scan (OWASP, Snyk)
189
- - Performance baseline (optional)
190
-
191
- ### Dashboards
192
-
193
- Replace Test Status Report with:
194
- - Pass/fail trend
195
- - Coverage trend
196
- - Open bugs by severity
197
- - Deployment frequency
198
- - Mean time to recovery (MTTR)
199
-
200
- ---
201
-
202
- ## Checklist: Applying Tailoring
203
-
204
- - [ ] Context identified: Agile / Scrum / DevOps / Hybrid
205
- - [ ] Document set chosen: Minimal / Hybrid / Full
206
- - [ ] Merged documents listed (e.g., "Test Plan + Level Plans → single doc")
207
- - [ ] Omitted sections documented (e.g., "Readiness reports omitted; checklist in Confluence")
208
- - [ ] Tool integration specified (Jira, Zephyr, CI, etc.)
209
- - [ ] Traceability preserved (requirement → test case → execution → incident)
210
- - [ ] Stakeholder sign-off approach defined (async, PO, formal)
211
- - [ ] Review cadence set (sprint, release, quarterly)
212
-
213
- ---
214
-
215
- ## When NOT to Over-Tailor
216
-
217
- - **Regulated domains** (medical, finance, aviation): Keep formal documents; tailor format, not content.
218
- - **Contractual requirements**: Customer may require specific ISO documents; confirm before omitting.
219
- - **Audit trail**: If audits occur, ensure tool exports or generated reports satisfy auditors.
220
- - **Distributed teams**: Slightly more documentation helps remote collaboration.
@@ -1,302 +0,0 @@
1
- # ISO/IEC/IEEE 29119-3 Document Types Reference
2
-
3
- *Per ISO/IEC/IEEE 29119-3:2021 — Software and systems engineering — Software testing — Part 3: Test documentation*
4
-
5
- ## Document Hierarchy
6
-
7
- ```
8
- Test Policy
9
- └── Organizational Test Practices
10
- └── Project Test Plan
11
- ├── Level Test Plans (unit/integration/system/acceptance)
12
- ├── Type Test Plans (functional/performance/security)
13
- └── Test Specifications
14
- ├── Test Model Specification
15
- ├── Test Case Specification
16
- └── Test Procedure Specification
17
- ```
18
-
19
- ---
20
-
21
- ## Governance Documents
22
-
23
- ### Test Policy
24
-
25
- **Purpose:** High-level organizational commitment to testing. Defines testing objectives, principles, and governance.
26
-
27
- | Section | Mandatory | Recommended | Description |
28
- |---------|-----------|-------------|-------------|
29
- | Purpose | ✓ | | Why the policy exists |
30
- | Scope | ✓ | | Organizational scope |
31
- | Testing objectives | ✓ | | High-level goals |
32
- | Testing principles | | ✓ | Guiding principles |
33
- | Roles and responsibilities | | ✓ | Who governs testing |
34
- | References | | ✓ | Related standards, policies |
35
-
36
- ---
37
-
38
- ### Organizational Test Practices
39
-
40
- **Purpose:** Describes how the organization implements testing. Operationalizes the Test Policy.
41
-
42
- | Section | Mandatory | Recommended | Description |
43
- |---------|-----------|-------------|-------------|
44
- | Purpose | ✓ | | Purpose of the practices |
45
- | Scope | ✓ | | Applicability |
46
- | Test process description | ✓ | | How testing is performed |
47
- | Test documentation practices | ✓ | | Which documents are used |
48
- | Test environment management | | ✓ | Environment setup and control |
49
- | Test data management | | ✓ | Data creation, masking, retention |
50
- | Tools and automation | | ✓ | Tool strategy |
51
- | References | | ✓ | Test Policy, standards |
52
-
53
- ---
54
-
55
- ## Planning Documents
56
-
57
- ### Project Test Plan
58
-
59
- **Purpose:** Describes the testing approach for a specific project. May be decomposed into Level and Type Test Plans.
60
-
61
- | Section | Mandatory | Recommended | Description |
62
- |---------|-----------|-------------|-------------|
63
- | Introduction | ✓ | | Purpose, scope, definitions |
64
- | Test items | ✓ | | Features to test, features not to test |
65
- | Test approach | ✓ | | Strategy per level/type |
66
- | Pass/fail criteria | ✓ | | Measurable criteria |
67
- | Entry criteria | ✓ | | Conditions to start testing |
68
- | Exit criteria | ✓ | | Conditions to complete testing |
69
- | Suspension/resumption | ✓ | | When to halt/resume |
70
- | Deliverables | ✓ | | Expected artifacts |
71
- | Test environment | ✓ | | Environment requirements |
72
- | Schedule | ✓ | | Timeline, milestones |
73
- | Staffing | ✓ | | Roles, responsibilities |
74
- | Risks and contingencies | | ✓ | Risks and mitigations |
75
- | Approvals | | ✓ | Sign-off table |
76
-
77
- ---
78
-
79
- ### Level Test Plans
80
-
81
- **Purpose:** Plans for a specific test level (unit, integration, system, acceptance).
82
-
83
- | Level | Description |
84
- |-------|-------------|
85
- | **Unit** | Component-level testing |
86
- | **Integration** | Interface and interaction testing |
87
- | **System** | End-to-end system testing |
88
- | **Acceptance** | User/business acceptance |
89
-
90
- **Sections:** Same structure as Project Test Plan, scoped to the level. May reference parent Project Test Plan for shared elements.
91
-
92
- ---
93
-
94
- ### Type Test Plans
95
-
96
- **Purpose:** Plans for a specific test type (functional, performance, security, etc.).
97
-
98
- | Type | Description |
99
- |------|-------------|
100
- | **Functional** | Functional behavior verification |
101
- | **Performance** | Load, stress, scalability |
102
- | **Security** | Security vulnerabilities, OWASP |
103
- | **Usability** | UX, accessibility (WCAG) |
104
- | **Compatibility** | Browsers, devices, OS |
105
-
106
- **Sections:** Same structure as Project Test Plan, scoped to the type. May reference NFR criteria from qa-nfr-analyst.
107
-
108
- ---
109
-
110
- ## Specification Documents
111
-
112
- ### Test Model Specification
113
-
114
- **Purpose:** Describes test models used to derive test cases. Replaces "test conditions" in ISO 29119-3:2021. Models include state diagrams, decision tables, equivalence classes, boundary values.
115
-
116
- | Section | Mandatory | Recommended | Description |
117
- |---------|-----------|-------------|-------------|
118
- | Identifier | ✓ | | Unique ID (e.g., TMS-001) |
119
- | Purpose | ✓ | | Purpose of the model |
120
- | Scope | ✓ | | What the model covers |
121
- | Model description | ✓ | | Model content (diagram, table, etc.) |
122
- | Traceability | ✓ | | Links to requirements |
123
- | References | | ✓ | Source requirements, specs |
124
-
125
- ---
126
-
127
- ### Test Case Specification
128
-
129
- **Purpose:** Defines individual test cases derived from test models.
130
-
131
- | Section | Mandatory | Recommended | Description |
132
- |---------|-----------|-------------|-------------|
133
- | Identifier | ✓ | | Unique ID (e.g., TC-001) |
134
- | Purpose | ✓ | | Purpose of the test case |
135
- | Preconditions | ✓ | | Prerequisites |
136
- | Input specifications | ✓ | | Test inputs |
137
- | Expected results | ✓ | | Expected outcomes |
138
- | Postconditions | | ✓ | State after execution |
139
- | Traceability | ✓ | | Links to test model, requirements |
140
- | Priority | | ✓ | Priority level |
141
-
142
- ---
143
-
144
- ### Test Procedure Specification
145
-
146
- **Purpose:** Step-by-step instructions for executing test cases.
147
-
148
- | Section | Mandatory | Recommended | Description |
149
- |---------|-----------|-------------|-------------|
150
- | Identifier | ✓ | | Unique ID (e.g., TPS-001) |
151
- | Purpose | ✓ | | Purpose of the procedure |
152
- | Test cases covered | ✓ | | TC-001, TC-002, ... |
153
- | Prerequisites | ✓ | | Setup requirements |
154
- | Procedure steps | ✓ | | Numbered steps |
155
- | Expected results per step | | ✓ | Per-step expectations |
156
- | Traceability | ✓ | | Links to test cases |
157
-
158
- ---
159
-
160
- ## Execution Documents
161
-
162
- ### Test Execution Log
163
-
164
- **Purpose:** Records the execution of test procedures. Captures date, tester, result, actual vs expected.
165
-
166
- | Section | Mandatory | Recommended | Description |
167
- |---------|-----------|-------------|-------------|
168
- | Identifier | ✓ | | Log ID |
169
- | Test procedure | ✓ | | TPS reference |
170
- | Execution date/time | ✓ | | When executed |
171
- | Tester | ✓ | | Who executed |
172
- | Result | ✓ | | Pass/Fail/Blocked/Skipped |
173
- | Actual results | ✓ | | What was observed |
174
- | Environment/build | | ✓ | SUT version, build ID |
175
- | Evidence | | ✓ | Screenshots, logs |
176
-
177
- ---
178
-
179
- ### Test Incident Report (Bug Report / Defect Report)
180
-
181
- **Purpose:** Records deviations between expected and actual results. Synonymous with bug report, defect report.
182
-
183
- | Section | Mandatory | Recommended | Description |
184
- |---------|-----------|-------------|-------------|
185
- | Identifier | ✓ | | Unique ID (e.g., TIR-001) |
186
- | Summary | ✓ | | Brief description |
187
- | Test case/procedure | ✓ | | Which test failed |
188
- | Expected result | ✓ | | What was expected |
189
- | Actual result | ✓ | | What occurred |
190
- | Steps to reproduce | ✓ | | How to reproduce |
191
- | Severity/priority | | ✓ | Impact and urgency |
192
- | Status | | ✓ | Open, fixed, deferred |
193
- | Environment | | ✓ | Build, OS, browser |
194
- | Evidence | | ✓ | Attachments |
195
-
196
- ---
197
-
198
- ## Reporting Documents
199
-
200
- ### Test Status Report
201
-
202
- **Purpose:** Periodic progress report during test execution.
203
-
204
- | Section | Mandatory | Recommended | Description |
205
- |---------|-----------|-------------|-------------|
206
- | Identifier | ✓ | | Report ID |
207
- | Reporting period | ✓ | | Date range |
208
- | Summary | ✓ | | Executive summary |
209
- | Test execution summary | ✓ | | Pass/fail/blocked counts |
210
- | Incidents | ✓ | | Open/closed incident summary |
211
- | Risks and issues | | ✓ | Blockers, risks |
212
- | Next period plan | | ✓ | Planned activities |
213
- | Metrics | | ✓ | Coverage, progress % |
214
-
215
- ---
216
-
217
- ### Test Completion Report
218
-
219
- **Purpose:** Final report when testing is complete. Summarizes outcomes and recommendations.
220
-
221
- | Section | Mandatory | Recommended | Description |
222
- |---------|-----------|-------------|-------------|
223
- | Identifier | ✓ | | Report ID |
224
- | Summary | ✓ | | Executive summary |
225
- | Test execution summary | ✓ | | Final pass/fail/blocked counts |
226
- | Exit criteria met | ✓ | | Whether criteria were satisfied |
227
- | Incidents summary | ✓ | | Open, closed, deferred |
228
- | Recommendations | ✓ | | Release readiness, follow-up |
229
- | Lessons learned | | ✓ | Process improvements |
230
- | Metrics | | ✓ | Coverage, defect density |
231
-
232
- ---
233
-
234
- ## Readiness Documents
235
-
236
- ### Test Data Requirements
237
-
238
- **Purpose:** Specifies data needed for testing.
239
-
240
- | Section | Mandatory | Recommended | Description |
241
- |---------|-----------|-------------|-------------|
242
- | Identifier | ✓ | | Document ID |
243
- | Purpose | ✓ | | Purpose of the data |
244
- | Data requirements | ✓ | | Types, volumes, characteristics |
245
- | Data sources | | ✓ | Where data comes from |
246
- | Privacy/security | | ✓ | Masking, anonymization |
247
- | Traceability | | ✓ | Links to test cases |
248
-
249
- ---
250
-
251
- ### Test Environment Requirements
252
-
253
- **Purpose:** Specifies environment needed for testing.
254
-
255
- | Section | Mandatory | Recommended | Description |
256
- |---------|-----------|-------------|-------------|
257
- | Identifier | ✓ | | Document ID |
258
- | Purpose | ✓ | | Purpose of the environment |
259
- | Hardware | ✓ | | Servers, devices |
260
- | Software | ✓ | | OS, middleware, tools |
261
- | Network | | ✓ | Connectivity requirements |
262
- | Access/credentials | | ✓ | Access requirements (no secrets) |
263
- | Traceability | | ✓ | Links to test plans |
264
-
265
- ---
266
-
267
- ### Test Data Readiness Report
268
-
269
- **Purpose:** Confirms test data is ready for use.
270
-
271
- | Section | Mandatory | Recommended | Description |
272
- |---------|-----------|-------------|-------------|
273
- | Identifier | ✓ | | Report ID |
274
- | Status | ✓ | | Ready/Not ready |
275
- | Data sets | ✓ | | What was prepared |
276
- | Gaps | | ✓ | Missing or incomplete data |
277
- | Traceability | | ✓ | Links to Test Data Requirements |
278
-
279
- ---
280
-
281
- ### Test Environment Readiness Report
282
-
283
- **Purpose:** Confirms test environment is ready for use.
284
-
285
- | Section | Mandatory | Recommended | Description |
286
- |---------|-----------|-------------|-------------|
287
- | Identifier | ✓ | | Report ID |
288
- | Status | ✓ | | Ready/Not ready |
289
- | Components | ✓ | | What was set up |
290
- | Gaps | | ✓ | Missing or incomplete components |
291
- | Traceability | | ✓ | Links to Test Environment Requirements |
292
-
293
- ---
294
-
295
- ## Information Element Necessity
296
-
297
- ISO 29119-3 classifies each information element as:
298
- - **Mandatory** — Must be present
299
- - **Recommended** — Should be present unless tailored out
300
- - **Possible** — Optional, include when useful
301
-
302
- Tailoring is permitted; document which elements are omitted and why.