qa-skills 3.0.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (262) hide show
  1. package/README.md +168 -0
  2. package/bin/cli.js +42 -0
  3. package/dist/agents/registry.d.ts +5 -0
  4. package/dist/agents/registry.d.ts.map +1 -0
  5. package/dist/agents/registry.js +101 -0
  6. package/dist/agents/registry.js.map +1 -0
  7. package/dist/agents/types.d.ts +9 -0
  8. package/dist/agents/types.d.ts.map +1 -0
  9. package/dist/agents/types.js +2 -0
  10. package/dist/agents/types.js.map +1 -0
  11. package/dist/dependencies.d.ts +21 -0
  12. package/dist/dependencies.d.ts.map +1 -0
  13. package/dist/dependencies.js +125 -0
  14. package/dist/dependencies.js.map +1 -0
  15. package/dist/installer.d.ts +25 -0
  16. package/dist/installer.d.ts.map +1 -0
  17. package/dist/installer.js +437 -0
  18. package/dist/installer.js.map +1 -0
  19. package/dist/scaffold.d.ts +27 -0
  20. package/dist/scaffold.d.ts.map +1 -0
  21. package/dist/scaffold.js +182 -0
  22. package/dist/scaffold.js.map +1 -0
  23. package/package.json +40 -0
  24. package/skills/qa-accessibility-test-writer/SKILL.md +127 -0
  25. package/skills/qa-accessibility-test-writer/references/axe-core-patterns.md +349 -0
  26. package/skills/qa-accessibility-test-writer/references/best-practices.md +184 -0
  27. package/skills/qa-accessibility-test-writer/references/wcag-tests.md +331 -0
  28. package/skills/qa-api-contract-curator/SKILL.md +104 -0
  29. package/skills/qa-api-contract-curator/references/breaking-changes.md +363 -0
  30. package/skills/qa-api-contract-curator/references/openapi-structure.md +404 -0
  31. package/skills/qa-browser-data-collector/SKILL.md +132 -0
  32. package/skills/qa-browser-data-collector/references/data-collection-checklist.md +91 -0
  33. package/skills/qa-browser-data-collector/references/playwright-mcp-patterns.md +113 -0
  34. package/skills/qa-bug-ticket-creator/SKILL.md +148 -0
  35. package/skills/qa-bug-ticket-creator/references/bug-report-format.md +149 -0
  36. package/skills/qa-bug-ticket-creator/references/severity-guide.md +81 -0
  37. package/skills/qa-bug-ticket-creator/templates/bug-ticket-template.md +39 -0
  38. package/skills/qa-changelog-analyzer/SKILL.md +134 -0
  39. package/skills/qa-changelog-analyzer/references/git-analysis-patterns.md +138 -0
  40. package/skills/qa-changelog-analyzer/references/impact-mapping.md +120 -0
  41. package/skills/qa-clickup-integration/SKILL.md +166 -0
  42. package/skills/qa-clickup-integration/references/api-patterns.md +102 -0
  43. package/skills/qa-clickup-integration/references/field-mapping.md +71 -0
  44. package/skills/qa-codeceptjs-writer/SKILL.md +136 -0
  45. package/skills/qa-codeceptjs-writer/references/best-practices.md +207 -0
  46. package/skills/qa-codeceptjs-writer/references/config.md +255 -0
  47. package/skills/qa-codeceptjs-writer/references/patterns.md +285 -0
  48. package/skills/qa-coverage-analyzer/SKILL.md +166 -0
  49. package/skills/qa-coverage-analyzer/references/best-practices.md +142 -0
  50. package/skills/qa-coverage-analyzer/references/coverage-dimensions.md +155 -0
  51. package/skills/qa-coverage-analyzer/references/tools.md +204 -0
  52. package/skills/qa-cypress-writer/SKILL.md +134 -0
  53. package/skills/qa-cypress-writer/references/assertions.md +121 -0
  54. package/skills/qa-cypress-writer/references/best-practices.md +82 -0
  55. package/skills/qa-cypress-writer/references/config.md +121 -0
  56. package/skills/qa-cypress-writer/references/patterns.md +170 -0
  57. package/skills/qa-data-factory/SKILL.md +126 -0
  58. package/skills/qa-data-factory/references/factory-patterns.md +164 -0
  59. package/skills/qa-data-factory/references/faker-guide.md +131 -0
  60. package/skills/qa-diagram-generator/SKILL.md +125 -0
  61. package/skills/qa-diagram-generator/references/c4-model.md +53 -0
  62. package/skills/qa-diagram-generator/references/charts.md +58 -0
  63. package/skills/qa-diagram-generator/references/class-diagram.md +85 -0
  64. package/skills/qa-diagram-generator/references/er-diagram.md +69 -0
  65. package/skills/qa-diagram-generator/references/flowchart.md +92 -0
  66. package/skills/qa-diagram-generator/references/from-screenshot.md +45 -0
  67. package/skills/qa-diagram-generator/references/gantt.md +49 -0
  68. package/skills/qa-diagram-generator/references/journey.md +50 -0
  69. package/skills/qa-diagram-generator/references/mindmap.md +75 -0
  70. package/skills/qa-diagram-generator/references/sequence.md +69 -0
  71. package/skills/qa-diagram-generator/references/state-diagram.md +56 -0
  72. package/skills/qa-discovery-interview/SKILL.md +182 -0
  73. package/skills/qa-discovery-interview/references/completeness-checklist.md +53 -0
  74. package/skills/qa-discovery-interview/references/conflict-patterns.md +101 -0
  75. package/skills/qa-discovery-interview/references/qa-categories.md +147 -0
  76. package/skills/qa-discovery-interview/templates/qa-brief-template.md +168 -0
  77. package/skills/qa-environment-checker/SKILL.md +142 -0
  78. package/skills/qa-environment-checker/references/dependency-matrix.md +101 -0
  79. package/skills/qa-environment-checker/references/health-checks.md +209 -0
  80. package/skills/qa-environment-checker/templates/env-readiness-template.md +64 -0
  81. package/skills/qa-flaky-detector/SKILL.md +153 -0
  82. package/skills/qa-flaky-detector/references/ci-analysis.md +140 -0
  83. package/skills/qa-flaky-detector/references/flaky-patterns.md +247 -0
  84. package/skills/qa-github-issues-enhanced/SKILL.md +175 -0
  85. package/skills/qa-github-issues-enhanced/references/issue-templates.md +425 -0
  86. package/skills/qa-github-issues-enhanced/references/label-taxonomy.md +130 -0
  87. package/skills/qa-github-issues-enhanced/references/workflow-patterns.md +188 -0
  88. package/skills/qa-httpx-writer/SKILL.md +138 -0
  89. package/skills/qa-httpx-writer/references/assertions.md +195 -0
  90. package/skills/qa-httpx-writer/references/best-practices.md +140 -0
  91. package/skills/qa-httpx-writer/references/config.md +212 -0
  92. package/skills/qa-httpx-writer/references/patterns.md +262 -0
  93. package/skills/qa-jest-writer/SKILL.md +131 -0
  94. package/skills/qa-jest-writer/references/assertions.md +125 -0
  95. package/skills/qa-jest-writer/references/best-practices.md +136 -0
  96. package/skills/qa-jest-writer/references/config.md +134 -0
  97. package/skills/qa-jest-writer/references/patterns.md +172 -0
  98. package/skills/qa-jira-integration/SKILL.md +135 -0
  99. package/skills/qa-jira-integration/references/api-patterns.md +143 -0
  100. package/skills/qa-jira-integration/references/field-mapping.md +79 -0
  101. package/skills/qa-jira-integration/references/xray-integration.md +85 -0
  102. package/skills/qa-jmeter-writer/SKILL.md +171 -0
  103. package/skills/qa-jmeter-writer/references/best-practices.md +157 -0
  104. package/skills/qa-jmeter-writer/references/config.md +204 -0
  105. package/skills/qa-jmeter-writer/references/patterns.md +242 -0
  106. package/skills/qa-junit5-writer/SKILL.md +157 -0
  107. package/skills/qa-junit5-writer/references/assertions.md +118 -0
  108. package/skills/qa-junit5-writer/references/config.md +97 -0
  109. package/skills/qa-junit5-writer/references/patterns.md +162 -0
  110. package/skills/qa-k6-writer/SKILL.md +155 -0
  111. package/skills/qa-k6-writer/references/best-practices.md +236 -0
  112. package/skills/qa-k6-writer/references/config.md +219 -0
  113. package/skills/qa-k6-writer/references/patterns.md +304 -0
  114. package/skills/qa-linear-integration/SKILL.md +137 -0
  115. package/skills/qa-linear-integration/references/api-patterns.md +249 -0
  116. package/skills/qa-linear-integration/references/field-mapping.md +121 -0
  117. package/skills/qa-locust-writer/SKILL.md +151 -0
  118. package/skills/qa-locust-writer/references/best-practices.md +126 -0
  119. package/skills/qa-locust-writer/references/config.md +170 -0
  120. package/skills/qa-locust-writer/references/patterns.md +235 -0
  121. package/skills/qa-manual-test-designer/SKILL.md +145 -0
  122. package/skills/qa-manual-test-designer/references/exploratory-charters.md +138 -0
  123. package/skills/qa-manual-test-designer/references/personas.md +146 -0
  124. package/skills/qa-manual-test-designer/templates/exploratory-charter-template.md +47 -0
  125. package/skills/qa-manual-test-designer/templates/test-case-template.md +31 -0
  126. package/skills/qa-mobile-test-writer/SKILL.md +144 -0
  127. package/skills/qa-mobile-test-writer/references/best-practices.md +214 -0
  128. package/skills/qa-mobile-test-writer/references/config.md +309 -0
  129. package/skills/qa-mobile-test-writer/references/patterns.md +304 -0
  130. package/skills/qa-nfr-analyst/SKILL.md +177 -0
  131. package/skills/qa-nfr-analyst/references/iso-25010-model.md +159 -0
  132. package/skills/qa-nfr-analyst/references/owasp-wstg-baseline.md +202 -0
  133. package/skills/qa-nfr-analyst/references/wcag-checklist.md +184 -0
  134. package/skills/qa-nfr-analyst/templates/owasp-checklist-template.md +89 -0
  135. package/skills/qa-nfr-analyst/templates/wcag-checklist-template.md +48 -0
  136. package/skills/qa-orchestrator/SKILL.md +132 -0
  137. package/skills/qa-orchestrator/references/handoff-chains.md +105 -0
  138. package/skills/qa-orchestrator/references/pipeline-modes.md +115 -0
  139. package/skills/qa-orchestrator/references/scheduler-rules.md +84 -0
  140. package/skills/qa-pact-writer/SKILL.md +133 -0
  141. package/skills/qa-pact-writer/references/best-practices.md +100 -0
  142. package/skills/qa-pact-writer/references/config.md +135 -0
  143. package/skills/qa-pact-writer/references/patterns.md +161 -0
  144. package/skills/qa-plan-creator/SKILL.md +139 -0
  145. package/skills/qa-plan-creator/references/introduction-plan.md +43 -0
  146. package/skills/qa-plan-creator/references/migration-plan.md +44 -0
  147. package/skills/qa-plan-creator/references/onboarding-plan.md +46 -0
  148. package/skills/qa-plan-creator/references/performance-plan.md +44 -0
  149. package/skills/qa-plan-creator/references/regression-plan.md +45 -0
  150. package/skills/qa-plan-creator/references/release-plan.md +45 -0
  151. package/skills/qa-plan-creator/references/sprint-plan.md +44 -0
  152. package/skills/qa-plan-creator/references/test-plan.md +59 -0
  153. package/skills/qa-plan-creator/references/uat-plan.md +43 -0
  154. package/skills/qa-plan-creator/templates/checklist-template.md +36 -0
  155. package/skills/qa-plan-creator/templates/regression-checklist-template.md +49 -0
  156. package/skills/qa-plan-creator/templates/release-checklist-template.md +46 -0
  157. package/skills/qa-plan-creator/templates/test-plan-template.md +74 -0
  158. package/skills/qa-playwright-py-writer/SKILL.md +156 -0
  159. package/skills/qa-playwright-py-writer/references/best-practices.md +194 -0
  160. package/skills/qa-playwright-py-writer/references/config.md +195 -0
  161. package/skills/qa-playwright-py-writer/references/patterns.md +212 -0
  162. package/skills/qa-playwright-ts-writer/SKILL.md +151 -0
  163. package/skills/qa-playwright-ts-writer/references/assertions.md +109 -0
  164. package/skills/qa-playwright-ts-writer/references/best-practices.md +191 -0
  165. package/skills/qa-playwright-ts-writer/references/config.md +144 -0
  166. package/skills/qa-playwright-ts-writer/references/patterns.md +171 -0
  167. package/skills/qa-pytest-writer/SKILL.md +145 -0
  168. package/skills/qa-pytest-writer/references/assertions.md +149 -0
  169. package/skills/qa-pytest-writer/references/best-practices.md +97 -0
  170. package/skills/qa-pytest-writer/references/config.md +176 -0
  171. package/skills/qa-pytest-writer/references/patterns.md +251 -0
  172. package/skills/qa-qase-integration/SKILL.md +149 -0
  173. package/skills/qa-qase-integration/references/api-reference.md +354 -0
  174. package/skills/qa-qase-integration/references/ci-integration.md +196 -0
  175. package/skills/qa-qase-integration/references/field-mapping.md +157 -0
  176. package/skills/qa-requirements-generator/SKILL.md +152 -0
  177. package/skills/qa-requirements-generator/references/iso-29148-structure.md +153 -0
  178. package/skills/qa-requirements-generator/references/requirement-patterns.md +278 -0
  179. package/skills/qa-rest-assured-writer/SKILL.md +137 -0
  180. package/skills/qa-rest-assured-writer/references/best-practices.md +50 -0
  181. package/skills/qa-rest-assured-writer/references/config.md +124 -0
  182. package/skills/qa-rest-assured-writer/references/patterns.md +192 -0
  183. package/skills/qa-risk-analyzer/SKILL.md +158 -0
  184. package/skills/qa-risk-analyzer/references/impact-analysis.md +133 -0
  185. package/skills/qa-risk-analyzer/references/risk-factors.md +123 -0
  186. package/skills/qa-robot-framework-writer/SKILL.md +147 -0
  187. package/skills/qa-robot-framework-writer/references/best-practices.md +249 -0
  188. package/skills/qa-robot-framework-writer/references/config.md +204 -0
  189. package/skills/qa-robot-framework-writer/references/libraries.md +273 -0
  190. package/skills/qa-robot-framework-writer/references/patterns.md +216 -0
  191. package/skills/qa-security-test-writer/SKILL.md +123 -0
  192. package/skills/qa-security-test-writer/references/best-practices.md +155 -0
  193. package/skills/qa-security-test-writer/references/owasp-top10.md +331 -0
  194. package/skills/qa-security-test-writer/references/zap-config.md +258 -0
  195. package/skills/qa-selenium-java-writer/SKILL.md +143 -0
  196. package/skills/qa-selenium-java-writer/references/best-practices.md +59 -0
  197. package/skills/qa-selenium-java-writer/references/config.md +143 -0
  198. package/skills/qa-selenium-java-writer/references/patterns.md +170 -0
  199. package/skills/qa-selenium-py-writer/SKILL.md +150 -0
  200. package/skills/qa-selenium-py-writer/references/best-practices.md +175 -0
  201. package/skills/qa-selenium-py-writer/references/config.md +224 -0
  202. package/skills/qa-selenium-py-writer/references/patterns.md +255 -0
  203. package/skills/qa-shortcut-integration/SKILL.md +143 -0
  204. package/skills/qa-shortcut-integration/references/api-patterns.md +126 -0
  205. package/skills/qa-shortcut-integration/references/field-mapping.md +66 -0
  206. package/skills/qa-spec-auditor/SKILL.md +162 -0
  207. package/skills/qa-spec-auditor/references/audit-checklist.md +144 -0
  208. package/skills/qa-spec-auditor/references/drift-patterns.md +207 -0
  209. package/skills/qa-spec-writer/SKILL.md +143 -0
  210. package/skills/qa-spec-writer/references/gherkin-guide.md +253 -0
  211. package/skills/qa-spec-writer/references/specification-patterns.md +274 -0
  212. package/skills/qa-spring-test-writer/SKILL.md +170 -0
  213. package/skills/qa-spring-test-writer/references/best-practices.md +57 -0
  214. package/skills/qa-spring-test-writer/references/config.md +179 -0
  215. package/skills/qa-spring-test-writer/references/patterns.md +235 -0
  216. package/skills/qa-supertest-writer/SKILL.md +150 -0
  217. package/skills/qa-supertest-writer/references/assertions.md +192 -0
  218. package/skills/qa-supertest-writer/references/best-practices.md +102 -0
  219. package/skills/qa-supertest-writer/references/config.md +166 -0
  220. package/skills/qa-supertest-writer/references/patterns.md +242 -0
  221. package/skills/qa-task-creator/SKILL.md +142 -0
  222. package/skills/qa-task-creator/references/linking-patterns.md +127 -0
  223. package/skills/qa-task-creator/references/task-types.md +169 -0
  224. package/skills/qa-task-creator/templates/task-template.md +24 -0
  225. package/skills/qa-test-doc-compiler/SKILL.md +114 -0
  226. package/skills/qa-test-doc-compiler/references/agile-tailoring.md +220 -0
  227. package/skills/qa-test-doc-compiler/references/iso-29119-3-documents.md +302 -0
  228. package/skills/qa-test-healer/SKILL.md +101 -0
  229. package/skills/qa-test-healer/references/diagnosis-patterns.md +142 -0
  230. package/skills/qa-test-healer/references/fix-strategies.md +177 -0
  231. package/skills/qa-test-reporter/SKILL.md +130 -0
  232. package/skills/qa-test-reporter/references/best-practices.md +162 -0
  233. package/skills/qa-test-reporter/references/iso-29119-reports.md +236 -0
  234. package/skills/qa-test-reporter/references/report-formats.md +287 -0
  235. package/skills/qa-test-reviewer/SKILL.md +142 -0
  236. package/skills/qa-test-reviewer/references/anti-patterns.md +268 -0
  237. package/skills/qa-test-reviewer/references/review-checklist.md +93 -0
  238. package/skills/qa-test-strategy/SKILL.md +133 -0
  239. package/skills/qa-test-strategy/references/entry-exit-criteria.md +176 -0
  240. package/skills/qa-test-strategy/references/risk-matrix.md +102 -0
  241. package/skills/qa-test-strategy/references/testing-types.md +143 -0
  242. package/skills/qa-testcase-from-docs/SKILL.md +161 -0
  243. package/skills/qa-testcase-from-docs/references/test-case-format.md +196 -0
  244. package/skills/qa-testcase-from-docs/references/test-design-techniques.md +126 -0
  245. package/skills/qa-testcase-from-docs/templates/test-case-template.md +31 -0
  246. package/skills/qa-testcase-from-ui/SKILL.md +109 -0
  247. package/skills/qa-testcase-from-ui/references/ui-element-patterns.md +126 -0
  248. package/skills/qa-testcase-from-ui/references/visual-analysis-guide.md +146 -0
  249. package/skills/qa-testcase-from-ui/templates/test-case-template.md +31 -0
  250. package/skills/qa-visual-regression-writer/SKILL.md +175 -0
  251. package/skills/qa-visual-regression-writer/references/best-practices.md +154 -0
  252. package/skills/qa-visual-regression-writer/references/config.md +220 -0
  253. package/skills/qa-visual-regression-writer/references/patterns.md +213 -0
  254. package/skills/qa-vitest-writer/SKILL.md +141 -0
  255. package/skills/qa-vitest-writer/references/assertions.md +105 -0
  256. package/skills/qa-vitest-writer/references/best-practices.md +62 -0
  257. package/skills/qa-vitest-writer/references/config.md +127 -0
  258. package/skills/qa-vitest-writer/references/patterns.md +141 -0
  259. package/skills/qa-webdriverio-writer/SKILL.md +145 -0
  260. package/skills/qa-webdriverio-writer/references/best-practices.md +176 -0
  261. package/skills/qa-webdriverio-writer/references/config.md +240 -0
  262. package/skills/qa-webdriverio-writer/references/patterns.md +269 -0
@@ -0,0 +1,114 @@
1
+ ---
2
+ name: qa-test-doc-compiler
3
+ description: Compile formal test documentation per ISO/IEC/IEEE 29119-3 including test policies, plans, specifications, execution logs, incident reports, and completion reports.
4
+ output_dir: docs/compiled
5
+ dependencies:
6
+ recommended:
7
+ - qa-test-reporter
8
+ ---
9
+
10
+ # QA Test Doc Compiler
11
+
12
+ ## Purpose
13
+
14
+ Compile formal test documentation per ISO/IEC/IEEE 29119-3. Collect inputs from other QA skills, organize content per ISO structure, format documents, and validate completeness. Supports tailoring for Agile, Scrum, and DevOps contexts.
15
+
16
+ ## Document Types
17
+
18
+ | Category | Document Types |
19
+ | -------- | -------------- |
20
+ | **Governance** | Test Policy, Organizational Test Practices |
21
+ | **Planning** | Project Test Plan, Level Test Plans (unit/integration/system/acceptance), Type Test Plans (functional/performance/security) |
22
+ | **Specification** | Test Model Specification, Test Case Specification, Test Procedure Specification |
23
+ | **Execution** | Test Execution Log, Test Incident Report |
24
+ | **Reporting** | Test Status Report, Test Completion Report |
25
+ | **Readiness** | Test Data Requirements, Test Environment Requirements, Test Data Readiness Report, Test Environment Readiness Report |
26
+
27
+ See `references/iso-29119-3-documents.md` for required sections per document type.
28
+
29
+ ## Document Compilation Workflow
30
+
31
+ 1. **Collect inputs** — Gather content from other skills:
32
+ - `qa-requirements-generator` → requirements, acceptance criteria
33
+ - `qa-plan-creator` → test plans, sprint plans, release plans
34
+ - `qa-spec-writer` → specifications, acceptance criteria
35
+ - `qa-testcase-from-docs` → test cases, RTM
36
+ - `qa-nfr-analyst` → NFR criteria for performance/security plans
37
+ - Manual inputs: execution logs, incident reports, status updates
38
+
39
+ 2. **Organize per ISO structure** — Map content to ISO 29119-3 document templates. Use `references/iso-29119-3-documents.md` for mandatory/recommended sections.
40
+
41
+ 3. **Format** — Apply consistent formatting (Markdown, tables, traceability IDs). Call `qa-diagram-generator` for Gantt charts, flowcharts, or RTM visualizations when needed.
42
+
43
+ 4. **Validate completeness** — Check:
44
+ - All mandatory sections present
45
+ - Traceability links preserved (requirement → test model → test case → procedure)
46
+ - IDs follow project conventions
47
+ - No orphaned references
48
+
49
+ 5. **Tailor for context** — If Agile/DevOps, apply `references/agile-tailoring.md` to reduce ceremony and merge documents where appropriate.
50
+
51
+ ## Trigger Phrases
52
+
53
+ - "Compile test documentation per ISO 29119-3"
54
+ - "Create test policy / organizational test practices"
55
+ - "Assemble test plan from [sources]"
56
+ - "Format test execution log / incident report"
57
+ - "Generate test completion report"
58
+ - "Tailor ISO 29119-3 for Agile/DevOps"
59
+
60
+ ## Scope
61
+
62
+ **Can do (autonomous):**
63
+ - Compile any ISO 29119-3 document type from provided inputs
64
+ - Organize content into ISO structure
65
+ - Merge outputs from multiple QA skills into coherent documents
66
+ - Apply Agile/DevOps tailoring per reference guide
67
+ - Call qa-diagram-generator for timelines, RTM, flowcharts
68
+ - Validate mandatory sections and traceability
69
+
70
+ **Cannot do (requires confirmation):**
71
+ - Create content from scratch without inputs (policy, practices, plans need stakeholder input)
72
+ - Override organizational test policy or practices
73
+ - Change scope or priorities set by stakeholders
74
+
75
+ **Will not do (out of scope):**
76
+ - Execute tests or automation
77
+ - Modify production code or environments
78
+ - Approve documents (approval is stakeholder responsibility)
79
+ - Generate test code
80
+
81
+ ## Embedding: Diagram Generator
82
+
83
+ When visualization is needed, reference qa-diagram-generator:
84
+ - **Timelines** → `references/gantt.md`
85
+ - **Traceability** → `references/flowchart.md` or mindmap
86
+ - **Test flow** → `references/sequence.md`
87
+
88
+ ## Quality Checklist
89
+
90
+ - [ ] Document type matches ISO 29119-3 definition
91
+ - [ ] All mandatory sections present per `references/iso-29119-3-documents.md`
92
+ - [ ] Traceability links preserved (REQ → model → case → procedure)
93
+ - [ ] IDs follow project conventions (e.g., TC-001, TIR-001)
94
+ - [ ] Agile tailoring applied when context is Agile/DevOps
95
+ - [ ] No hardcoded secrets or sensitive data
96
+ - [ ] Format consistent (Markdown, tables, headings)
97
+
98
+ ## Troubleshooting
99
+
100
+ | Symptom | Likely Cause | Fix |
101
+ | ------- | ------------ | --- |
102
+ | Missing mandatory sections | Inputs incomplete or wrong document type | Check `references/iso-29119-3-documents.md`; request missing inputs |
103
+ | Broken traceability links | IDs changed or content merged incorrectly | Re-map requirement → test case links; validate RTM |
104
+ | Document too heavy for Agile | Full ISO structure applied | Apply `references/agile-tailoring.md`; merge/omit non-essential sections |
105
+ | Inconsistent formatting | Multiple sources with different styles | Normalize to single template; use consistent ID prefixes |
106
+ | Orphaned references | Deleted or renamed items | Audit references; update or remove broken links |
107
+ | Policy conflicts with plan | Stakeholder input contradicts | Flag for resolution; do not override policy |
108
+
109
+ ## Reference Files
110
+
111
+ | Topic | File |
112
+ | ----- | ---- |
113
+ | ISO 29119-3 document types & sections | `references/iso-29119-3-documents.md` |
114
+ | Agile/Scrum/DevOps tailoring | `references/agile-tailoring.md` |
@@ -0,0 +1,220 @@
1
+ # Agile/Scrum/DevOps Tailoring Guide for ISO 29119-3
2
+
3
+ *How to adapt ISO/IEC/IEEE 29119-3 test documentation for Agile, Scrum, and DevOps contexts while preserving traceability and compliance.*
4
+
5
+ ## Principles
6
+
7
+ 1. **Reduce ceremony, not traceability** — Merge documents, shorten cycles, but keep requirement → test case links.
8
+ 2. **Living documents** — Confluence pages, wiki, or repo Markdown instead of static PDFs.
9
+ 3. **Automation-friendly** — Structure for tool integration (Jira, Zephyr, TestRail, Allure).
10
+ 4. **Just enough** — Include only what adds value for the team and stakeholders.
11
+
12
+ ---
13
+
14
+ ## Document Merging Strategies
15
+
16
+ ### Option A: Minimal Set (Sprint-based)
17
+
18
+ | ISO Document | Agile Equivalent |
19
+ |--------------|------------------|
20
+ | Test Policy | Org-level; rarely changes; 1-page summary |
21
+ | Organizational Test Practices | Definition of Done, DoD for testing; wiki page |
22
+ | Project Test Plan | Release/sprint 0 doc; high-level only |
23
+ | Level/Type Test Plans | Merged into single "Test Approach" section |
24
+ | Test Model Specification | Inline in test case or BDD feature file |
25
+ | Test Case Specification | Jira/Zephyr/TestRail; or Markdown in repo |
26
+ | Test Procedure Specification | Steps in test case; or automated (code = procedure) |
27
+ | Test Execution Log | CI/CD results; JUnit/Allure/TestRail |
28
+ | Test Incident Report | Bug ticket (Jira, GitHub Issues) |
29
+ | Test Status Report | Sprint burndown, dashboard, standup notes |
30
+ | Test Completion Report | Release retrospective; 1-page summary |
31
+ | Test Data/Environment Requirements | README or runbook; as-needed |
32
+ | Readiness Reports | Checklist in Confluence; or omitted if self-evident |
33
+
34
+ ### Option B: Hybrid (Regulated / Contract)
35
+
36
+ Keep formal documents for audit, but:
37
+ - Use templates; auto-populate from tools where possible
38
+ - Generate Test Completion Report from CI + bug tracker
39
+ - Keep Test Policy and Organizational Test Practices as living docs, reviewed quarterly
40
+
41
+ ### Option C: DevOps / Continuous Delivery
42
+
43
+ - **Test Plan** → Pipeline config, quality gates, deployment criteria
44
+ - **Test Case** → Automated test code + BDD scenarios
45
+ - **Execution Log** → CI logs, Allure/JUnit XML
46
+ - **Incident Report** → Bug ticket linked to failing test
47
+ - **Status/Completion** → Dashboard (Grafana, custom); no separate report unless requested
48
+
49
+ ---
50
+
51
+ ## Tailoring by Document Type
52
+
53
+ ### Test Policy
54
+
55
+ | Full ISO | Agile Tailoring |
56
+ |----------|------------------|
57
+ | Multi-page policy | 1-page summary: objectives, principles, governance |
58
+ | Formal approval cycle | Living doc; reviewed at org retro |
59
+ | Detailed roles | Link to RACI; keep high-level only |
60
+
61
+ ### Organizational Test Practices
62
+
63
+ | Full ISO | Agile Tailoring |
64
+ |----------|------------------|
65
+ | Separate document | Merge into "Testing" section of team wiki |
66
+ | Detailed process | Definition of Done for testing; Definition of Ready |
67
+ | Tool strategy | Tool section; link to pipeline docs |
68
+
69
+ ### Project Test Plan
70
+
71
+ | Full ISO | Agile Tailoring |
72
+ |----------|------------------|
73
+ | Full 13-section plan | Release/sprint 0: scope, approach, entry/exit, risks |
74
+ | Level + Type plans | Single "Test Approach" table: level × type × tools |
75
+ | Formal approvals | Async sign-off; or Product Owner acceptance |
76
+
77
+ ### Test Model Specification
78
+
79
+ | Full ISO | Agile Tailoring |
80
+ |----------|------------------|
81
+ | Standalone document | Inline in BDD feature (Given/When/Then) or test case |
82
+ | Formal traceability | Link in test case to requirement ID |
83
+ | Diagrams | Use qa-diagram-generator; embed in Confluence |
84
+
85
+ ### Test Case Specification
86
+
87
+ | Full ISO | Agile Tailoring |
88
+ |----------|------------------|
89
+ | Formal document | Test management tool (Zephyr, TestRail) or Markdown table |
90
+ | Full preconditions | Condensed; link to setup docs |
91
+ | Traceability | Requirement ID in test case; RTM auto-generated |
92
+
93
+ ### Test Procedure Specification
94
+
95
+ | Full ISO | Agile Tailoring |
96
+ |----------|------------------|
97
+ | Separate procedure doc | Steps in test case; or automated test = procedure |
98
+ | Manual procedures | Keep for manual/exploratory; automate where possible |
99
+
100
+ ### Test Execution Log
101
+
102
+ | Full ISO | Agile Tailoring |
103
+ |----------|------------------|
104
+ | Manual log | CI/CD results; JUnit XML, Allure, TestRail |
105
+ | Per-execution record | Pipeline run = execution; link build to test results |
106
+ | Manual tests | Log in tool; or lightweight spreadsheet |
107
+
108
+ ### Test Incident Report
109
+
110
+ | Full ISO | Agile Tailoring |
111
+ |----------|------------------|
112
+ | Formal TIR template | Bug ticket (Jira, GitHub Issues) with: expected, actual, steps, severity |
113
+ | Separate numbering | Use ticket ID (e.g., PROJ-123) |
114
+ | Traceability | Link bug to test case ID |
115
+
116
+ ### Test Status Report
117
+
118
+ | Full ISO | Agile Tailoring |
119
+ |----------|------------------|
120
+ | Periodic report | Sprint burndown, dashboard, standup summary |
121
+ | Formal document | Omit; or 1-page sprint test summary if stakeholder needs |
122
+ | Metrics | Coverage %, pass rate, open bugs; auto from tools |
123
+
124
+ ### Test Completion Report
125
+
126
+ | Full ISO | Agile Tailoring |
127
+ |----------|------------------|
128
+ | Formal report | Release retrospective; 1-page: summary, exit criteria met, recommendations |
129
+ | Full metrics | Link to dashboard; summarize key numbers |
130
+ | Lessons learned | Part of retro; optional section |
131
+
132
+ ### Test Data / Environment Requirements
133
+
134
+ | Full ISO | Agile Tailoring |
135
+ |----------|------------------|
136
+ | Formal document | README, runbook, or Confluence page |
137
+ | Readiness reports | Checklist; or omit if team self-manages |
138
+ | Traceability | Link from test plan or wiki |
139
+
140
+ ---
141
+
142
+ ## Scrum-Specific Patterns
143
+
144
+ ### Sprint Cycle
145
+
146
+ | Phase | Documents |
147
+ |-------|-----------|
148
+ | **Sprint Planning** | Sprint Test Plan (lightweight) or Test Approach in sprint goal |
149
+ | **Development** | Test cases in backlog; BDD scenarios in code |
150
+ | **Daily** | No formal doc; standup covers blockers |
151
+ | **Sprint Review** | Demo = informal execution; bugs logged |
152
+ | **Sprint Retro** | Update Organizational Test Practices if needed |
153
+ | **Release** | Test Completion Report (1-page) if release sign-off required |
154
+
155
+ ### Definition of Done (Testing)
156
+
157
+ Include in DoD:
158
+ - [ ] Test cases written for new/changed features
159
+ - [ ] Automated tests in pipeline where applicable
160
+ - [ ] No critical/high bugs open for release scope
161
+ - [ ] Test execution logged (CI or manual log)
162
+ - [ ] Traceability: requirement → test case
163
+
164
+ ### Definition of Ready (Testing)
165
+
166
+ - [ ] Acceptance criteria defined
167
+ - [ ] Test environment available
168
+ - [ ] Test data identified
169
+ - [ ] Dependencies known
170
+
171
+ ---
172
+
173
+ ## DevOps-Specific Patterns
174
+
175
+ ### Pipeline as Documentation
176
+
177
+ - **Test Plan** → Quality gates in pipeline (e.g., 80% pass, no critical failures)
178
+ - **Test Procedure** → Test code
179
+ - **Execution Log** → CI run logs, Allure report
180
+ - **Incident Report** → Bug created from failed test; auto-link
181
+
182
+ ### Quality Gates
183
+
184
+ Define in pipeline config:
185
+ - Unit test pass rate
186
+ - Integration test pass rate
187
+ - Coverage threshold
188
+ - Security scan (OWASP, Snyk)
189
+ - Performance baseline (optional)
190
+
191
+ ### Dashboards
192
+
193
+ Replace Test Status Report with:
194
+ - Pass/fail trend
195
+ - Coverage trend
196
+ - Open bugs by severity
197
+ - Deployment frequency
198
+ - Mean time to recovery (MTTR)
199
+
200
+ ---
201
+
202
+ ## Checklist: Applying Tailoring
203
+
204
+ - [ ] Context identified: Agile / Scrum / DevOps / Hybrid
205
+ - [ ] Document set chosen: Minimal / Hybrid / Full
206
+ - [ ] Merged documents listed (e.g., "Test Plan + Level Plans → single doc")
207
+ - [ ] Omitted sections documented (e.g., "Readiness reports omitted; checklist in Confluence")
208
+ - [ ] Tool integration specified (Jira, Zephyr, CI, etc.)
209
+ - [ ] Traceability preserved (requirement → test case → execution → incident)
210
+ - [ ] Stakeholder sign-off approach defined (async, PO, formal)
211
+ - [ ] Review cadence set (sprint, release, quarterly)
212
+
213
+ ---
214
+
215
+ ## When NOT to Over-Tailor
216
+
217
+ - **Regulated domains** (medical, finance, aviation): Keep formal documents; tailor format, not content.
218
+ - **Contractual requirements**: Customer may require specific ISO documents; confirm before omitting.
219
+ - **Audit trail**: If audits occur, ensure tool exports or generated reports satisfy auditors.
220
+ - **Distributed teams**: Slightly more documentation helps remote collaboration.
@@ -0,0 +1,302 @@
1
+ # ISO/IEC/IEEE 29119-3 Document Types Reference
2
+
3
+ *Per ISO/IEC/IEEE 29119-3:2021 — Software and systems engineering — Software testing — Part 3: Test documentation*
4
+
5
+ ## Document Hierarchy
6
+
7
+ ```
8
+ Test Policy
9
+ └── Organizational Test Practices
10
+ └── Project Test Plan
11
+ ├── Level Test Plans (unit/integration/system/acceptance)
12
+ ├── Type Test Plans (functional/performance/security)
13
+ └── Test Specifications
14
+ ├── Test Model Specification
15
+ ├── Test Case Specification
16
+ └── Test Procedure Specification
17
+ ```
18
+
19
+ ---
20
+
21
+ ## Governance Documents
22
+
23
+ ### Test Policy
24
+
25
+ **Purpose:** High-level organizational commitment to testing. Defines testing objectives, principles, and governance.
26
+
27
+ | Section | Mandatory | Recommended | Description |
28
+ |---------|-----------|-------------|-------------|
29
+ | Purpose | ✓ | | Why the policy exists |
30
+ | Scope | ✓ | | Organizational scope |
31
+ | Testing objectives | ✓ | | High-level goals |
32
+ | Testing principles | | ✓ | Guiding principles |
33
+ | Roles and responsibilities | | ✓ | Who governs testing |
34
+ | References | | ✓ | Related standards, policies |
35
+
36
+ ---
37
+
38
+ ### Organizational Test Practices
39
+
40
+ **Purpose:** Describes how the organization implements testing. Operationalizes the Test Policy.
41
+
42
+ | Section | Mandatory | Recommended | Description |
43
+ |---------|-----------|-------------|-------------|
44
+ | Purpose | ✓ | | Purpose of the practices |
45
+ | Scope | ✓ | | Applicability |
46
+ | Test process description | ✓ | | How testing is performed |
47
+ | Test documentation practices | ✓ | | Which documents are used |
48
+ | Test environment management | | ✓ | Environment setup and control |
49
+ | Test data management | | ✓ | Data creation, masking, retention |
50
+ | Tools and automation | | ✓ | Tool strategy |
51
+ | References | | ✓ | Test Policy, standards |
52
+
53
+ ---
54
+
55
+ ## Planning Documents
56
+
57
+ ### Project Test Plan
58
+
59
+ **Purpose:** Describes the testing approach for a specific project. May be decomposed into Level and Type Test Plans.
60
+
61
+ | Section | Mandatory | Recommended | Description |
62
+ |---------|-----------|-------------|-------------|
63
+ | Introduction | ✓ | | Purpose, scope, definitions |
64
+ | Test items | ✓ | | Features to test, features not to test |
65
+ | Test approach | ✓ | | Strategy per level/type |
66
+ | Pass/fail criteria | ✓ | | Measurable criteria |
67
+ | Entry criteria | ✓ | | Conditions to start testing |
68
+ | Exit criteria | ✓ | | Conditions to complete testing |
69
+ | Suspension/resumption | ✓ | | When to halt/resume |
70
+ | Deliverables | ✓ | | Expected artifacts |
71
+ | Test environment | ✓ | | Environment requirements |
72
+ | Schedule | ✓ | | Timeline, milestones |
73
+ | Staffing | ✓ | | Roles, responsibilities |
74
+ | Risks and contingencies | | ✓ | Risks and mitigations |
75
+ | Approvals | | ✓ | Sign-off table |
76
+
77
+ ---
78
+
79
+ ### Level Test Plans
80
+
81
+ **Purpose:** Plans for a specific test level (unit, integration, system, acceptance).
82
+
83
+ | Level | Description |
84
+ |-------|-------------|
85
+ | **Unit** | Component-level testing |
86
+ | **Integration** | Interface and interaction testing |
87
+ | **System** | End-to-end system testing |
88
+ | **Acceptance** | User/business acceptance |
89
+
90
+ **Sections:** Same structure as Project Test Plan, scoped to the level. May reference parent Project Test Plan for shared elements.
91
+
92
+ ---
93
+
94
+ ### Type Test Plans
95
+
96
+ **Purpose:** Plans for a specific test type (functional, performance, security, etc.).
97
+
98
+ | Type | Description |
99
+ |------|-------------|
100
+ | **Functional** | Functional behavior verification |
101
+ | **Performance** | Load, stress, scalability |
102
+ | **Security** | Security vulnerabilities, OWASP |
103
+ | **Usability** | UX, accessibility (WCAG) |
104
+ | **Compatibility** | Browsers, devices, OS |
105
+
106
+ **Sections:** Same structure as Project Test Plan, scoped to the type. May reference NFR criteria from qa-nfr-analyst.
107
+
108
+ ---
109
+
110
+ ## Specification Documents
111
+
112
+ ### Test Model Specification
113
+
114
+ **Purpose:** Describes test models used to derive test cases. Replaces "test conditions" in ISO 29119-3:2021. Models include state diagrams, decision tables, equivalence classes, boundary values.
115
+
116
+ | Section | Mandatory | Recommended | Description |
117
+ |---------|-----------|-------------|-------------|
118
+ | Identifier | ✓ | | Unique ID (e.g., TMS-001) |
119
+ | Purpose | ✓ | | Purpose of the model |
120
+ | Scope | ✓ | | What the model covers |
121
+ | Model description | ✓ | | Model content (diagram, table, etc.) |
122
+ | Traceability | ✓ | | Links to requirements |
123
+ | References | | ✓ | Source requirements, specs |
124
+
125
+ ---
126
+
127
+ ### Test Case Specification
128
+
129
+ **Purpose:** Defines individual test cases derived from test models.
130
+
131
+ | Section | Mandatory | Recommended | Description |
132
+ |---------|-----------|-------------|-------------|
133
+ | Identifier | ✓ | | Unique ID (e.g., TC-001) |
134
+ | Purpose | ✓ | | Purpose of the test case |
135
+ | Preconditions | ✓ | | Prerequisites |
136
+ | Input specifications | ✓ | | Test inputs |
137
+ | Expected results | ✓ | | Expected outcomes |
138
+ | Postconditions | | ✓ | State after execution |
139
+ | Traceability | ✓ | | Links to test model, requirements |
140
+ | Priority | | ✓ | Priority level |
141
+
142
+ ---
143
+
144
+ ### Test Procedure Specification
145
+
146
+ **Purpose:** Step-by-step instructions for executing test cases.
147
+
148
+ | Section | Mandatory | Recommended | Description |
149
+ |---------|-----------|-------------|-------------|
150
+ | Identifier | ✓ | | Unique ID (e.g., TPS-001) |
151
+ | Purpose | ✓ | | Purpose of the procedure |
152
+ | Test cases covered | ✓ | | TC-001, TC-002, ... |
153
+ | Prerequisites | ✓ | | Setup requirements |
154
+ | Procedure steps | ✓ | | Numbered steps |
155
+ | Expected results per step | | ✓ | Per-step expectations |
156
+ | Traceability | ✓ | | Links to test cases |
157
+
158
+ ---
159
+
160
+ ## Execution Documents
161
+
162
+ ### Test Execution Log
163
+
164
+ **Purpose:** Records the execution of test procedures. Captures date, tester, result, actual vs expected.
165
+
166
+ | Section | Mandatory | Recommended | Description |
167
+ |---------|-----------|-------------|-------------|
168
+ | Identifier | ✓ | | Log ID |
169
+ | Test procedure | ✓ | | TPS reference |
170
+ | Execution date/time | ✓ | | When executed |
171
+ | Tester | ✓ | | Who executed |
172
+ | Result | ✓ | | Pass/Fail/Blocked/Skipped |
173
+ | Actual results | ✓ | | What was observed |
174
+ | Environment/build | | ✓ | SUT version, build ID |
175
+ | Evidence | | ✓ | Screenshots, logs |
176
+
177
+ ---
178
+
179
+ ### Test Incident Report (Bug Report / Defect Report)
180
+
181
+ **Purpose:** Records deviations between expected and actual results. Synonymous with bug report, defect report.
182
+
183
+ | Section | Mandatory | Recommended | Description |
184
+ |---------|-----------|-------------|-------------|
185
+ | Identifier | ✓ | | Unique ID (e.g., TIR-001) |
186
+ | Summary | ✓ | | Brief description |
187
+ | Test case/procedure | ✓ | | Which test failed |
188
+ | Expected result | ✓ | | What was expected |
189
+ | Actual result | ✓ | | What occurred |
190
+ | Steps to reproduce | ✓ | | How to reproduce |
191
+ | Severity/priority | | ✓ | Impact and urgency |
192
+ | Status | | ✓ | Open, fixed, deferred |
193
+ | Environment | | ✓ | Build, OS, browser |
194
+ | Evidence | | ✓ | Attachments |
195
+
196
+ ---
197
+
198
+ ## Reporting Documents
199
+
200
+ ### Test Status Report
201
+
202
+ **Purpose:** Periodic progress report during test execution.
203
+
204
+ | Section | Mandatory | Recommended | Description |
205
+ |---------|-----------|-------------|-------------|
206
+ | Identifier | ✓ | | Report ID |
207
+ | Reporting period | ✓ | | Date range |
208
+ | Summary | ✓ | | Executive summary |
209
+ | Test execution summary | ✓ | | Pass/fail/blocked counts |
210
+ | Incidents | ✓ | | Open/closed incident summary |
211
+ | Risks and issues | | ✓ | Blockers, risks |
212
+ | Next period plan | | ✓ | Planned activities |
213
+ | Metrics | | ✓ | Coverage, progress % |
214
+
215
+ ---
216
+
217
+ ### Test Completion Report
218
+
219
+ **Purpose:** Final report when testing is complete. Summarizes outcomes and recommendations.
220
+
221
+ | Section | Mandatory | Recommended | Description |
222
+ |---------|-----------|-------------|-------------|
223
+ | Identifier | ✓ | | Report ID |
224
+ | Summary | ✓ | | Executive summary |
225
+ | Test execution summary | ✓ | | Final pass/fail/blocked counts |
226
+ | Exit criteria met | ✓ | | Whether criteria were satisfied |
227
+ | Incidents summary | ✓ | | Open, closed, deferred |
228
+ | Recommendations | ✓ | | Release readiness, follow-up |
229
+ | Lessons learned | | ✓ | Process improvements |
230
+ | Metrics | | ✓ | Coverage, defect density |
231
+
232
+ ---
233
+
234
+ ## Readiness Documents
235
+
236
+ ### Test Data Requirements
237
+
238
+ **Purpose:** Specifies data needed for testing.
239
+
240
+ | Section | Mandatory | Recommended | Description |
241
+ |---------|-----------|-------------|-------------|
242
+ | Identifier | ✓ | | Document ID |
243
+ | Purpose | ✓ | | Purpose of the data |
244
+ | Data requirements | ✓ | | Types, volumes, characteristics |
245
+ | Data sources | | ✓ | Where data comes from |
246
+ | Privacy/security | | ✓ | Masking, anonymization |
247
+ | Traceability | | ✓ | Links to test cases |
248
+
249
+ ---
250
+
251
+ ### Test Environment Requirements
252
+
253
+ **Purpose:** Specifies environment needed for testing.
254
+
255
+ | Section | Mandatory | Recommended | Description |
256
+ |---------|-----------|-------------|-------------|
257
+ | Identifier | ✓ | | Document ID |
258
+ | Purpose | ✓ | | Purpose of the environment |
259
+ | Hardware | ✓ | | Servers, devices |
260
+ | Software | ✓ | | OS, middleware, tools |
261
+ | Network | | ✓ | Connectivity requirements |
262
+ | Access/credentials | | ✓ | Access requirements (no secrets) |
263
+ | Traceability | | ✓ | Links to test plans |
264
+
265
+ ---
266
+
267
+ ### Test Data Readiness Report
268
+
269
+ **Purpose:** Confirms test data is ready for use.
270
+
271
+ | Section | Mandatory | Recommended | Description |
272
+ |---------|-----------|-------------|-------------|
273
+ | Identifier | ✓ | | Report ID |
274
+ | Status | ✓ | | Ready/Not ready |
275
+ | Data sets | ✓ | | What was prepared |
276
+ | Gaps | | ✓ | Missing or incomplete data |
277
+ | Traceability | | ✓ | Links to Test Data Requirements |
278
+
279
+ ---
280
+
281
+ ### Test Environment Readiness Report
282
+
283
+ **Purpose:** Confirms test environment is ready for use.
284
+
285
+ | Section | Mandatory | Recommended | Description |
286
+ |---------|-----------|-------------|-------------|
287
+ | Identifier | ✓ | | Report ID |
288
+ | Status | ✓ | | Ready/Not ready |
289
+ | Components | ✓ | | What was set up |
290
+ | Gaps | | ✓ | Missing or incomplete components |
291
+ | Traceability | | ✓ | Links to Test Environment Requirements |
292
+
293
+ ---
294
+
295
+ ## Information Element Necessity
296
+
297
+ ISO 29119-3 classifies each information element as:
298
+ - **Mandatory** — Must be present
299
+ - **Recommended** — Should be present unless tailored out
300
+ - **Possible** — Optional, include when useful
301
+
302
+ Tailoring is permitted; document which elements are omitted and why.