qa-skills 3.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +168 -0
- package/bin/cli.js +42 -0
- package/dist/agents/registry.d.ts +5 -0
- package/dist/agents/registry.d.ts.map +1 -0
- package/dist/agents/registry.js +101 -0
- package/dist/agents/registry.js.map +1 -0
- package/dist/agents/types.d.ts +9 -0
- package/dist/agents/types.d.ts.map +1 -0
- package/dist/agents/types.js +2 -0
- package/dist/agents/types.js.map +1 -0
- package/dist/dependencies.d.ts +21 -0
- package/dist/dependencies.d.ts.map +1 -0
- package/dist/dependencies.js +125 -0
- package/dist/dependencies.js.map +1 -0
- package/dist/installer.d.ts +25 -0
- package/dist/installer.d.ts.map +1 -0
- package/dist/installer.js +437 -0
- package/dist/installer.js.map +1 -0
- package/dist/scaffold.d.ts +27 -0
- package/dist/scaffold.d.ts.map +1 -0
- package/dist/scaffold.js +182 -0
- package/dist/scaffold.js.map +1 -0
- package/package.json +40 -0
- package/skills/qa-accessibility-test-writer/SKILL.md +127 -0
- package/skills/qa-accessibility-test-writer/references/axe-core-patterns.md +349 -0
- package/skills/qa-accessibility-test-writer/references/best-practices.md +184 -0
- package/skills/qa-accessibility-test-writer/references/wcag-tests.md +331 -0
- package/skills/qa-api-contract-curator/SKILL.md +104 -0
- package/skills/qa-api-contract-curator/references/breaking-changes.md +363 -0
- package/skills/qa-api-contract-curator/references/openapi-structure.md +404 -0
- package/skills/qa-browser-data-collector/SKILL.md +132 -0
- package/skills/qa-browser-data-collector/references/data-collection-checklist.md +91 -0
- package/skills/qa-browser-data-collector/references/playwright-mcp-patterns.md +113 -0
- package/skills/qa-bug-ticket-creator/SKILL.md +148 -0
- package/skills/qa-bug-ticket-creator/references/bug-report-format.md +149 -0
- package/skills/qa-bug-ticket-creator/references/severity-guide.md +81 -0
- package/skills/qa-bug-ticket-creator/templates/bug-ticket-template.md +39 -0
- package/skills/qa-changelog-analyzer/SKILL.md +134 -0
- package/skills/qa-changelog-analyzer/references/git-analysis-patterns.md +138 -0
- package/skills/qa-changelog-analyzer/references/impact-mapping.md +120 -0
- package/skills/qa-clickup-integration/SKILL.md +166 -0
- package/skills/qa-clickup-integration/references/api-patterns.md +102 -0
- package/skills/qa-clickup-integration/references/field-mapping.md +71 -0
- package/skills/qa-codeceptjs-writer/SKILL.md +136 -0
- package/skills/qa-codeceptjs-writer/references/best-practices.md +207 -0
- package/skills/qa-codeceptjs-writer/references/config.md +255 -0
- package/skills/qa-codeceptjs-writer/references/patterns.md +285 -0
- package/skills/qa-coverage-analyzer/SKILL.md +166 -0
- package/skills/qa-coverage-analyzer/references/best-practices.md +142 -0
- package/skills/qa-coverage-analyzer/references/coverage-dimensions.md +155 -0
- package/skills/qa-coverage-analyzer/references/tools.md +204 -0
- package/skills/qa-cypress-writer/SKILL.md +134 -0
- package/skills/qa-cypress-writer/references/assertions.md +121 -0
- package/skills/qa-cypress-writer/references/best-practices.md +82 -0
- package/skills/qa-cypress-writer/references/config.md +121 -0
- package/skills/qa-cypress-writer/references/patterns.md +170 -0
- package/skills/qa-data-factory/SKILL.md +126 -0
- package/skills/qa-data-factory/references/factory-patterns.md +164 -0
- package/skills/qa-data-factory/references/faker-guide.md +131 -0
- package/skills/qa-diagram-generator/SKILL.md +125 -0
- package/skills/qa-diagram-generator/references/c4-model.md +53 -0
- package/skills/qa-diagram-generator/references/charts.md +58 -0
- package/skills/qa-diagram-generator/references/class-diagram.md +85 -0
- package/skills/qa-diagram-generator/references/er-diagram.md +69 -0
- package/skills/qa-diagram-generator/references/flowchart.md +92 -0
- package/skills/qa-diagram-generator/references/from-screenshot.md +45 -0
- package/skills/qa-diagram-generator/references/gantt.md +49 -0
- package/skills/qa-diagram-generator/references/journey.md +50 -0
- package/skills/qa-diagram-generator/references/mindmap.md +75 -0
- package/skills/qa-diagram-generator/references/sequence.md +69 -0
- package/skills/qa-diagram-generator/references/state-diagram.md +56 -0
- package/skills/qa-discovery-interview/SKILL.md +182 -0
- package/skills/qa-discovery-interview/references/completeness-checklist.md +53 -0
- package/skills/qa-discovery-interview/references/conflict-patterns.md +101 -0
- package/skills/qa-discovery-interview/references/qa-categories.md +147 -0
- package/skills/qa-discovery-interview/templates/qa-brief-template.md +168 -0
- package/skills/qa-environment-checker/SKILL.md +142 -0
- package/skills/qa-environment-checker/references/dependency-matrix.md +101 -0
- package/skills/qa-environment-checker/references/health-checks.md +209 -0
- package/skills/qa-environment-checker/templates/env-readiness-template.md +64 -0
- package/skills/qa-flaky-detector/SKILL.md +153 -0
- package/skills/qa-flaky-detector/references/ci-analysis.md +140 -0
- package/skills/qa-flaky-detector/references/flaky-patterns.md +247 -0
- package/skills/qa-github-issues-enhanced/SKILL.md +175 -0
- package/skills/qa-github-issues-enhanced/references/issue-templates.md +425 -0
- package/skills/qa-github-issues-enhanced/references/label-taxonomy.md +130 -0
- package/skills/qa-github-issues-enhanced/references/workflow-patterns.md +188 -0
- package/skills/qa-httpx-writer/SKILL.md +138 -0
- package/skills/qa-httpx-writer/references/assertions.md +195 -0
- package/skills/qa-httpx-writer/references/best-practices.md +140 -0
- package/skills/qa-httpx-writer/references/config.md +212 -0
- package/skills/qa-httpx-writer/references/patterns.md +262 -0
- package/skills/qa-jest-writer/SKILL.md +131 -0
- package/skills/qa-jest-writer/references/assertions.md +125 -0
- package/skills/qa-jest-writer/references/best-practices.md +136 -0
- package/skills/qa-jest-writer/references/config.md +134 -0
- package/skills/qa-jest-writer/references/patterns.md +172 -0
- package/skills/qa-jira-integration/SKILL.md +135 -0
- package/skills/qa-jira-integration/references/api-patterns.md +143 -0
- package/skills/qa-jira-integration/references/field-mapping.md +79 -0
- package/skills/qa-jira-integration/references/xray-integration.md +85 -0
- package/skills/qa-jmeter-writer/SKILL.md +171 -0
- package/skills/qa-jmeter-writer/references/best-practices.md +157 -0
- package/skills/qa-jmeter-writer/references/config.md +204 -0
- package/skills/qa-jmeter-writer/references/patterns.md +242 -0
- package/skills/qa-junit5-writer/SKILL.md +157 -0
- package/skills/qa-junit5-writer/references/assertions.md +118 -0
- package/skills/qa-junit5-writer/references/config.md +97 -0
- package/skills/qa-junit5-writer/references/patterns.md +162 -0
- package/skills/qa-k6-writer/SKILL.md +155 -0
- package/skills/qa-k6-writer/references/best-practices.md +236 -0
- package/skills/qa-k6-writer/references/config.md +219 -0
- package/skills/qa-k6-writer/references/patterns.md +304 -0
- package/skills/qa-linear-integration/SKILL.md +137 -0
- package/skills/qa-linear-integration/references/api-patterns.md +249 -0
- package/skills/qa-linear-integration/references/field-mapping.md +121 -0
- package/skills/qa-locust-writer/SKILL.md +151 -0
- package/skills/qa-locust-writer/references/best-practices.md +126 -0
- package/skills/qa-locust-writer/references/config.md +170 -0
- package/skills/qa-locust-writer/references/patterns.md +235 -0
- package/skills/qa-manual-test-designer/SKILL.md +145 -0
- package/skills/qa-manual-test-designer/references/exploratory-charters.md +138 -0
- package/skills/qa-manual-test-designer/references/personas.md +146 -0
- package/skills/qa-manual-test-designer/templates/exploratory-charter-template.md +47 -0
- package/skills/qa-manual-test-designer/templates/test-case-template.md +31 -0
- package/skills/qa-mobile-test-writer/SKILL.md +144 -0
- package/skills/qa-mobile-test-writer/references/best-practices.md +214 -0
- package/skills/qa-mobile-test-writer/references/config.md +309 -0
- package/skills/qa-mobile-test-writer/references/patterns.md +304 -0
- package/skills/qa-nfr-analyst/SKILL.md +177 -0
- package/skills/qa-nfr-analyst/references/iso-25010-model.md +159 -0
- package/skills/qa-nfr-analyst/references/owasp-wstg-baseline.md +202 -0
- package/skills/qa-nfr-analyst/references/wcag-checklist.md +184 -0
- package/skills/qa-nfr-analyst/templates/owasp-checklist-template.md +89 -0
- package/skills/qa-nfr-analyst/templates/wcag-checklist-template.md +48 -0
- package/skills/qa-orchestrator/SKILL.md +132 -0
- package/skills/qa-orchestrator/references/handoff-chains.md +105 -0
- package/skills/qa-orchestrator/references/pipeline-modes.md +115 -0
- package/skills/qa-orchestrator/references/scheduler-rules.md +84 -0
- package/skills/qa-pact-writer/SKILL.md +133 -0
- package/skills/qa-pact-writer/references/best-practices.md +100 -0
- package/skills/qa-pact-writer/references/config.md +135 -0
- package/skills/qa-pact-writer/references/patterns.md +161 -0
- package/skills/qa-plan-creator/SKILL.md +139 -0
- package/skills/qa-plan-creator/references/introduction-plan.md +43 -0
- package/skills/qa-plan-creator/references/migration-plan.md +44 -0
- package/skills/qa-plan-creator/references/onboarding-plan.md +46 -0
- package/skills/qa-plan-creator/references/performance-plan.md +44 -0
- package/skills/qa-plan-creator/references/regression-plan.md +45 -0
- package/skills/qa-plan-creator/references/release-plan.md +45 -0
- package/skills/qa-plan-creator/references/sprint-plan.md +44 -0
- package/skills/qa-plan-creator/references/test-plan.md +59 -0
- package/skills/qa-plan-creator/references/uat-plan.md +43 -0
- package/skills/qa-plan-creator/templates/checklist-template.md +36 -0
- package/skills/qa-plan-creator/templates/regression-checklist-template.md +49 -0
- package/skills/qa-plan-creator/templates/release-checklist-template.md +46 -0
- package/skills/qa-plan-creator/templates/test-plan-template.md +74 -0
- package/skills/qa-playwright-py-writer/SKILL.md +156 -0
- package/skills/qa-playwright-py-writer/references/best-practices.md +194 -0
- package/skills/qa-playwright-py-writer/references/config.md +195 -0
- package/skills/qa-playwright-py-writer/references/patterns.md +212 -0
- package/skills/qa-playwright-ts-writer/SKILL.md +151 -0
- package/skills/qa-playwright-ts-writer/references/assertions.md +109 -0
- package/skills/qa-playwright-ts-writer/references/best-practices.md +191 -0
- package/skills/qa-playwright-ts-writer/references/config.md +144 -0
- package/skills/qa-playwright-ts-writer/references/patterns.md +171 -0
- package/skills/qa-pytest-writer/SKILL.md +145 -0
- package/skills/qa-pytest-writer/references/assertions.md +149 -0
- package/skills/qa-pytest-writer/references/best-practices.md +97 -0
- package/skills/qa-pytest-writer/references/config.md +176 -0
- package/skills/qa-pytest-writer/references/patterns.md +251 -0
- package/skills/qa-qase-integration/SKILL.md +149 -0
- package/skills/qa-qase-integration/references/api-reference.md +354 -0
- package/skills/qa-qase-integration/references/ci-integration.md +196 -0
- package/skills/qa-qase-integration/references/field-mapping.md +157 -0
- package/skills/qa-requirements-generator/SKILL.md +152 -0
- package/skills/qa-requirements-generator/references/iso-29148-structure.md +153 -0
- package/skills/qa-requirements-generator/references/requirement-patterns.md +278 -0
- package/skills/qa-rest-assured-writer/SKILL.md +137 -0
- package/skills/qa-rest-assured-writer/references/best-practices.md +50 -0
- package/skills/qa-rest-assured-writer/references/config.md +124 -0
- package/skills/qa-rest-assured-writer/references/patterns.md +192 -0
- package/skills/qa-risk-analyzer/SKILL.md +158 -0
- package/skills/qa-risk-analyzer/references/impact-analysis.md +133 -0
- package/skills/qa-risk-analyzer/references/risk-factors.md +123 -0
- package/skills/qa-robot-framework-writer/SKILL.md +147 -0
- package/skills/qa-robot-framework-writer/references/best-practices.md +249 -0
- package/skills/qa-robot-framework-writer/references/config.md +204 -0
- package/skills/qa-robot-framework-writer/references/libraries.md +273 -0
- package/skills/qa-robot-framework-writer/references/patterns.md +216 -0
- package/skills/qa-security-test-writer/SKILL.md +123 -0
- package/skills/qa-security-test-writer/references/best-practices.md +155 -0
- package/skills/qa-security-test-writer/references/owasp-top10.md +331 -0
- package/skills/qa-security-test-writer/references/zap-config.md +258 -0
- package/skills/qa-selenium-java-writer/SKILL.md +143 -0
- package/skills/qa-selenium-java-writer/references/best-practices.md +59 -0
- package/skills/qa-selenium-java-writer/references/config.md +143 -0
- package/skills/qa-selenium-java-writer/references/patterns.md +170 -0
- package/skills/qa-selenium-py-writer/SKILL.md +150 -0
- package/skills/qa-selenium-py-writer/references/best-practices.md +175 -0
- package/skills/qa-selenium-py-writer/references/config.md +224 -0
- package/skills/qa-selenium-py-writer/references/patterns.md +255 -0
- package/skills/qa-shortcut-integration/SKILL.md +143 -0
- package/skills/qa-shortcut-integration/references/api-patterns.md +126 -0
- package/skills/qa-shortcut-integration/references/field-mapping.md +66 -0
- package/skills/qa-spec-auditor/SKILL.md +162 -0
- package/skills/qa-spec-auditor/references/audit-checklist.md +144 -0
- package/skills/qa-spec-auditor/references/drift-patterns.md +207 -0
- package/skills/qa-spec-writer/SKILL.md +143 -0
- package/skills/qa-spec-writer/references/gherkin-guide.md +253 -0
- package/skills/qa-spec-writer/references/specification-patterns.md +274 -0
- package/skills/qa-spring-test-writer/SKILL.md +170 -0
- package/skills/qa-spring-test-writer/references/best-practices.md +57 -0
- package/skills/qa-spring-test-writer/references/config.md +179 -0
- package/skills/qa-spring-test-writer/references/patterns.md +235 -0
- package/skills/qa-supertest-writer/SKILL.md +150 -0
- package/skills/qa-supertest-writer/references/assertions.md +192 -0
- package/skills/qa-supertest-writer/references/best-practices.md +102 -0
- package/skills/qa-supertest-writer/references/config.md +166 -0
- package/skills/qa-supertest-writer/references/patterns.md +242 -0
- package/skills/qa-task-creator/SKILL.md +142 -0
- package/skills/qa-task-creator/references/linking-patterns.md +127 -0
- package/skills/qa-task-creator/references/task-types.md +169 -0
- package/skills/qa-task-creator/templates/task-template.md +24 -0
- package/skills/qa-test-doc-compiler/SKILL.md +114 -0
- package/skills/qa-test-doc-compiler/references/agile-tailoring.md +220 -0
- package/skills/qa-test-doc-compiler/references/iso-29119-3-documents.md +302 -0
- package/skills/qa-test-healer/SKILL.md +101 -0
- package/skills/qa-test-healer/references/diagnosis-patterns.md +142 -0
- package/skills/qa-test-healer/references/fix-strategies.md +177 -0
- package/skills/qa-test-reporter/SKILL.md +130 -0
- package/skills/qa-test-reporter/references/best-practices.md +162 -0
- package/skills/qa-test-reporter/references/iso-29119-reports.md +236 -0
- package/skills/qa-test-reporter/references/report-formats.md +287 -0
- package/skills/qa-test-reviewer/SKILL.md +142 -0
- package/skills/qa-test-reviewer/references/anti-patterns.md +268 -0
- package/skills/qa-test-reviewer/references/review-checklist.md +93 -0
- package/skills/qa-test-strategy/SKILL.md +133 -0
- package/skills/qa-test-strategy/references/entry-exit-criteria.md +176 -0
- package/skills/qa-test-strategy/references/risk-matrix.md +102 -0
- package/skills/qa-test-strategy/references/testing-types.md +143 -0
- package/skills/qa-testcase-from-docs/SKILL.md +161 -0
- package/skills/qa-testcase-from-docs/references/test-case-format.md +196 -0
- package/skills/qa-testcase-from-docs/references/test-design-techniques.md +126 -0
- package/skills/qa-testcase-from-docs/templates/test-case-template.md +31 -0
- package/skills/qa-testcase-from-ui/SKILL.md +109 -0
- package/skills/qa-testcase-from-ui/references/ui-element-patterns.md +126 -0
- package/skills/qa-testcase-from-ui/references/visual-analysis-guide.md +146 -0
- package/skills/qa-testcase-from-ui/templates/test-case-template.md +31 -0
- package/skills/qa-visual-regression-writer/SKILL.md +175 -0
- package/skills/qa-visual-regression-writer/references/best-practices.md +154 -0
- package/skills/qa-visual-regression-writer/references/config.md +220 -0
- package/skills/qa-visual-regression-writer/references/patterns.md +213 -0
- package/skills/qa-vitest-writer/SKILL.md +141 -0
- package/skills/qa-vitest-writer/references/assertions.md +105 -0
- package/skills/qa-vitest-writer/references/best-practices.md +62 -0
- package/skills/qa-vitest-writer/references/config.md +127 -0
- package/skills/qa-vitest-writer/references/patterns.md +141 -0
- package/skills/qa-webdriverio-writer/SKILL.md +145 -0
- package/skills/qa-webdriverio-writer/references/best-practices.md +176 -0
- package/skills/qa-webdriverio-writer/references/config.md +240 -0
- package/skills/qa-webdriverio-writer/references/patterns.md +269 -0
|
@@ -0,0 +1,114 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: qa-test-doc-compiler
|
|
3
|
+
description: Compile formal test documentation per ISO/IEC/IEEE 29119-3 including test policies, plans, specifications, execution logs, incident reports, and completion reports.
|
|
4
|
+
output_dir: docs/compiled
|
|
5
|
+
dependencies:
|
|
6
|
+
recommended:
|
|
7
|
+
- qa-test-reporter
|
|
8
|
+
---
|
|
9
|
+
|
|
10
|
+
# QA Test Doc Compiler
|
|
11
|
+
|
|
12
|
+
## Purpose
|
|
13
|
+
|
|
14
|
+
Compile formal test documentation per ISO/IEC/IEEE 29119-3. Collect inputs from other QA skills, organize content per ISO structure, format documents, and validate completeness. Supports tailoring for Agile, Scrum, and DevOps contexts.
|
|
15
|
+
|
|
16
|
+
## Document Types
|
|
17
|
+
|
|
18
|
+
| Category | Document Types |
|
|
19
|
+
| -------- | -------------- |
|
|
20
|
+
| **Governance** | Test Policy, Organizational Test Practices |
|
|
21
|
+
| **Planning** | Project Test Plan, Level Test Plans (unit/integration/system/acceptance), Type Test Plans (functional/performance/security) |
|
|
22
|
+
| **Specification** | Test Model Specification, Test Case Specification, Test Procedure Specification |
|
|
23
|
+
| **Execution** | Test Execution Log, Test Incident Report |
|
|
24
|
+
| **Reporting** | Test Status Report, Test Completion Report |
|
|
25
|
+
| **Readiness** | Test Data Requirements, Test Environment Requirements, Test Data Readiness Report, Test Environment Readiness Report |
|
|
26
|
+
|
|
27
|
+
See `references/iso-29119-3-documents.md` for required sections per document type.
|
|
28
|
+
|
|
29
|
+
## Document Compilation Workflow
|
|
30
|
+
|
|
31
|
+
1. **Collect inputs** — Gather content from other skills:
|
|
32
|
+
- `qa-requirements-generator` → requirements, acceptance criteria
|
|
33
|
+
- `qa-plan-creator` → test plans, sprint plans, release plans
|
|
34
|
+
- `qa-spec-writer` → specifications, acceptance criteria
|
|
35
|
+
- `qa-testcase-from-docs` → test cases, RTM
|
|
36
|
+
- `qa-nfr-analyst` → NFR criteria for performance/security plans
|
|
37
|
+
- Manual inputs: execution logs, incident reports, status updates
|
|
38
|
+
|
|
39
|
+
2. **Organize per ISO structure** — Map content to ISO 29119-3 document templates. Use `references/iso-29119-3-documents.md` for mandatory/recommended sections.
|
|
40
|
+
|
|
41
|
+
3. **Format** — Apply consistent formatting (Markdown, tables, traceability IDs). Call `qa-diagram-generator` for Gantt charts, flowcharts, or RTM visualizations when needed.
|
|
42
|
+
|
|
43
|
+
4. **Validate completeness** — Check:
|
|
44
|
+
- All mandatory sections present
|
|
45
|
+
- Traceability links preserved (requirement → test model → test case → procedure)
|
|
46
|
+
- IDs follow project conventions
|
|
47
|
+
- No orphaned references
|
|
48
|
+
|
|
49
|
+
5. **Tailor for context** — If Agile/DevOps, apply `references/agile-tailoring.md` to reduce ceremony and merge documents where appropriate.
|
|
50
|
+
|
|
51
|
+
## Trigger Phrases
|
|
52
|
+
|
|
53
|
+
- "Compile test documentation per ISO 29119-3"
|
|
54
|
+
- "Create test policy / organizational test practices"
|
|
55
|
+
- "Assemble test plan from [sources]"
|
|
56
|
+
- "Format test execution log / incident report"
|
|
57
|
+
- "Generate test completion report"
|
|
58
|
+
- "Tailor ISO 29119-3 for Agile/DevOps"
|
|
59
|
+
|
|
60
|
+
## Scope
|
|
61
|
+
|
|
62
|
+
**Can do (autonomous):**
|
|
63
|
+
- Compile any ISO 29119-3 document type from provided inputs
|
|
64
|
+
- Organize content into ISO structure
|
|
65
|
+
- Merge outputs from multiple QA skills into coherent documents
|
|
66
|
+
- Apply Agile/DevOps tailoring per reference guide
|
|
67
|
+
- Call qa-diagram-generator for timelines, RTM, flowcharts
|
|
68
|
+
- Validate mandatory sections and traceability
|
|
69
|
+
|
|
70
|
+
**Cannot do (requires confirmation):**
|
|
71
|
+
- Create content from scratch without inputs (policy, practices, plans need stakeholder input)
|
|
72
|
+
- Override organizational test policy or practices
|
|
73
|
+
- Change scope or priorities set by stakeholders
|
|
74
|
+
|
|
75
|
+
**Will not do (out of scope):**
|
|
76
|
+
- Execute tests or automation
|
|
77
|
+
- Modify production code or environments
|
|
78
|
+
- Approve documents (approval is stakeholder responsibility)
|
|
79
|
+
- Generate test code
|
|
80
|
+
|
|
81
|
+
## Embedding: Diagram Generator
|
|
82
|
+
|
|
83
|
+
When visualization is needed, reference qa-diagram-generator:
|
|
84
|
+
- **Timelines** → `references/gantt.md`
|
|
85
|
+
- **Traceability** → `references/flowchart.md` or mindmap
|
|
86
|
+
- **Test flow** → `references/sequence.md`
|
|
87
|
+
|
|
88
|
+
## Quality Checklist
|
|
89
|
+
|
|
90
|
+
- [ ] Document type matches ISO 29119-3 definition
|
|
91
|
+
- [ ] All mandatory sections present per `references/iso-29119-3-documents.md`
|
|
92
|
+
- [ ] Traceability links preserved (REQ → model → case → procedure)
|
|
93
|
+
- [ ] IDs follow project conventions (e.g., TC-001, TIR-001)
|
|
94
|
+
- [ ] Agile tailoring applied when context is Agile/DevOps
|
|
95
|
+
- [ ] No hardcoded secrets or sensitive data
|
|
96
|
+
- [ ] Format consistent (Markdown, tables, headings)
|
|
97
|
+
|
|
98
|
+
## Troubleshooting
|
|
99
|
+
|
|
100
|
+
| Symptom | Likely Cause | Fix |
|
|
101
|
+
| ------- | ------------ | --- |
|
|
102
|
+
| Missing mandatory sections | Inputs incomplete or wrong document type | Check `references/iso-29119-3-documents.md`; request missing inputs |
|
|
103
|
+
| Broken traceability links | IDs changed or content merged incorrectly | Re-map requirement → test case links; validate RTM |
|
|
104
|
+
| Document too heavy for Agile | Full ISO structure applied | Apply `references/agile-tailoring.md`; merge/omit non-essential sections |
|
|
105
|
+
| Inconsistent formatting | Multiple sources with different styles | Normalize to single template; use consistent ID prefixes |
|
|
106
|
+
| Orphaned references | Deleted or renamed items | Audit references; update or remove broken links |
|
|
107
|
+
| Policy conflicts with plan | Stakeholder input contradicts | Flag for resolution; do not override policy |
|
|
108
|
+
|
|
109
|
+
## Reference Files
|
|
110
|
+
|
|
111
|
+
| Topic | File |
|
|
112
|
+
| ----- | ---- |
|
|
113
|
+
| ISO 29119-3 document types & sections | `references/iso-29119-3-documents.md` |
|
|
114
|
+
| Agile/Scrum/DevOps tailoring | `references/agile-tailoring.md` |
|
|
@@ -0,0 +1,220 @@
|
|
|
1
|
+
# Agile/Scrum/DevOps Tailoring Guide for ISO 29119-3
|
|
2
|
+
|
|
3
|
+
*How to adapt ISO/IEC/IEEE 29119-3 test documentation for Agile, Scrum, and DevOps contexts while preserving traceability and compliance.*
|
|
4
|
+
|
|
5
|
+
## Principles
|
|
6
|
+
|
|
7
|
+
1. **Reduce ceremony, not traceability** — Merge documents, shorten cycles, but keep requirement → test case links.
|
|
8
|
+
2. **Living documents** — Confluence pages, wiki, or repo Markdown instead of static PDFs.
|
|
9
|
+
3. **Automation-friendly** — Structure for tool integration (Jira, Zephyr, TestRail, Allure).
|
|
10
|
+
4. **Just enough** — Include only what adds value for the team and stakeholders.
|
|
11
|
+
|
|
12
|
+
---
|
|
13
|
+
|
|
14
|
+
## Document Merging Strategies
|
|
15
|
+
|
|
16
|
+
### Option A: Minimal Set (Sprint-based)
|
|
17
|
+
|
|
18
|
+
| ISO Document | Agile Equivalent |
|
|
19
|
+
|--------------|------------------|
|
|
20
|
+
| Test Policy | Org-level; rarely changes; 1-page summary |
|
|
21
|
+
| Organizational Test Practices | Definition of Done, DoD for testing; wiki page |
|
|
22
|
+
| Project Test Plan | Release/sprint 0 doc; high-level only |
|
|
23
|
+
| Level/Type Test Plans | Merged into single "Test Approach" section |
|
|
24
|
+
| Test Model Specification | Inline in test case or BDD feature file |
|
|
25
|
+
| Test Case Specification | Jira/Zephyr/TestRail; or Markdown in repo |
|
|
26
|
+
| Test Procedure Specification | Steps in test case; or automated (code = procedure) |
|
|
27
|
+
| Test Execution Log | CI/CD results; JUnit/Allure/TestRail |
|
|
28
|
+
| Test Incident Report | Bug ticket (Jira, GitHub Issues) |
|
|
29
|
+
| Test Status Report | Sprint burndown, dashboard, standup notes |
|
|
30
|
+
| Test Completion Report | Release retrospective; 1-page summary |
|
|
31
|
+
| Test Data/Environment Requirements | README or runbook; as-needed |
|
|
32
|
+
| Readiness Reports | Checklist in Confluence; or omitted if self-evident |
|
|
33
|
+
|
|
34
|
+
### Option B: Hybrid (Regulated / Contract)
|
|
35
|
+
|
|
36
|
+
Keep formal documents for audit, but:
|
|
37
|
+
- Use templates; auto-populate from tools where possible
|
|
38
|
+
- Generate Test Completion Report from CI + bug tracker
|
|
39
|
+
- Keep Test Policy and Organizational Test Practices as living docs, reviewed quarterly
|
|
40
|
+
|
|
41
|
+
### Option C: DevOps / Continuous Delivery
|
|
42
|
+
|
|
43
|
+
- **Test Plan** → Pipeline config, quality gates, deployment criteria
|
|
44
|
+
- **Test Case** → Automated test code + BDD scenarios
|
|
45
|
+
- **Execution Log** → CI logs, Allure/JUnit XML
|
|
46
|
+
- **Incident Report** → Bug ticket linked to failing test
|
|
47
|
+
- **Status/Completion** → Dashboard (Grafana, custom); no separate report unless requested
|
|
48
|
+
|
|
49
|
+
---
|
|
50
|
+
|
|
51
|
+
## Tailoring by Document Type
|
|
52
|
+
|
|
53
|
+
### Test Policy
|
|
54
|
+
|
|
55
|
+
| Full ISO | Agile Tailoring |
|
|
56
|
+
|----------|------------------|
|
|
57
|
+
| Multi-page policy | 1-page summary: objectives, principles, governance |
|
|
58
|
+
| Formal approval cycle | Living doc; reviewed at org retro |
|
|
59
|
+
| Detailed roles | Link to RACI; keep high-level only |
|
|
60
|
+
|
|
61
|
+
### Organizational Test Practices
|
|
62
|
+
|
|
63
|
+
| Full ISO | Agile Tailoring |
|
|
64
|
+
|----------|------------------|
|
|
65
|
+
| Separate document | Merge into "Testing" section of team wiki |
|
|
66
|
+
| Detailed process | Definition of Done for testing; Definition of Ready |
|
|
67
|
+
| Tool strategy | Tool section; link to pipeline docs |
|
|
68
|
+
|
|
69
|
+
### Project Test Plan
|
|
70
|
+
|
|
71
|
+
| Full ISO | Agile Tailoring |
|
|
72
|
+
|----------|------------------|
|
|
73
|
+
| Full 13-section plan | Release/sprint 0: scope, approach, entry/exit, risks |
|
|
74
|
+
| Level + Type plans | Single "Test Approach" table: level × type × tools |
|
|
75
|
+
| Formal approvals | Async sign-off; or Product Owner acceptance |
|
|
76
|
+
|
|
77
|
+
### Test Model Specification
|
|
78
|
+
|
|
79
|
+
| Full ISO | Agile Tailoring |
|
|
80
|
+
|----------|------------------|
|
|
81
|
+
| Standalone document | Inline in BDD feature (Given/When/Then) or test case |
|
|
82
|
+
| Formal traceability | Link in test case to requirement ID |
|
|
83
|
+
| Diagrams | Use qa-diagram-generator; embed in Confluence |
|
|
84
|
+
|
|
85
|
+
### Test Case Specification
|
|
86
|
+
|
|
87
|
+
| Full ISO | Agile Tailoring |
|
|
88
|
+
|----------|------------------|
|
|
89
|
+
| Formal document | Test management tool (Zephyr, TestRail) or Markdown table |
|
|
90
|
+
| Full preconditions | Condensed; link to setup docs |
|
|
91
|
+
| Traceability | Requirement ID in test case; RTM auto-generated |
|
|
92
|
+
|
|
93
|
+
### Test Procedure Specification
|
|
94
|
+
|
|
95
|
+
| Full ISO | Agile Tailoring |
|
|
96
|
+
|----------|------------------|
|
|
97
|
+
| Separate procedure doc | Steps in test case; or automated test = procedure |
|
|
98
|
+
| Manual procedures | Keep for manual/exploratory; automate where possible |
|
|
99
|
+
|
|
100
|
+
### Test Execution Log
|
|
101
|
+
|
|
102
|
+
| Full ISO | Agile Tailoring |
|
|
103
|
+
|----------|------------------|
|
|
104
|
+
| Manual log | CI/CD results; JUnit XML, Allure, TestRail |
|
|
105
|
+
| Per-execution record | Pipeline run = execution; link build to test results |
|
|
106
|
+
| Manual tests | Log in tool; or lightweight spreadsheet |
|
|
107
|
+
|
|
108
|
+
### Test Incident Report
|
|
109
|
+
|
|
110
|
+
| Full ISO | Agile Tailoring |
|
|
111
|
+
|----------|------------------|
|
|
112
|
+
| Formal TIR template | Bug ticket (Jira, GitHub Issues) with: expected, actual, steps, severity |
|
|
113
|
+
| Separate numbering | Use ticket ID (e.g., PROJ-123) |
|
|
114
|
+
| Traceability | Link bug to test case ID |
|
|
115
|
+
|
|
116
|
+
### Test Status Report
|
|
117
|
+
|
|
118
|
+
| Full ISO | Agile Tailoring |
|
|
119
|
+
|----------|------------------|
|
|
120
|
+
| Periodic report | Sprint burndown, dashboard, standup summary |
|
|
121
|
+
| Formal document | Omit; or 1-page sprint test summary if stakeholder needs |
|
|
122
|
+
| Metrics | Coverage %, pass rate, open bugs; auto from tools |
|
|
123
|
+
|
|
124
|
+
### Test Completion Report
|
|
125
|
+
|
|
126
|
+
| Full ISO | Agile Tailoring |
|
|
127
|
+
|----------|------------------|
|
|
128
|
+
| Formal report | Release retrospective; 1-page: summary, exit criteria met, recommendations |
|
|
129
|
+
| Full metrics | Link to dashboard; summarize key numbers |
|
|
130
|
+
| Lessons learned | Part of retro; optional section |
|
|
131
|
+
|
|
132
|
+
### Test Data / Environment Requirements
|
|
133
|
+
|
|
134
|
+
| Full ISO | Agile Tailoring |
|
|
135
|
+
|----------|------------------|
|
|
136
|
+
| Formal document | README, runbook, or Confluence page |
|
|
137
|
+
| Readiness reports | Checklist; or omit if team self-manages |
|
|
138
|
+
| Traceability | Link from test plan or wiki |
|
|
139
|
+
|
|
140
|
+
---
|
|
141
|
+
|
|
142
|
+
## Scrum-Specific Patterns
|
|
143
|
+
|
|
144
|
+
### Sprint Cycle
|
|
145
|
+
|
|
146
|
+
| Phase | Documents |
|
|
147
|
+
|-------|-----------|
|
|
148
|
+
| **Sprint Planning** | Sprint Test Plan (lightweight) or Test Approach in sprint goal |
|
|
149
|
+
| **Development** | Test cases in backlog; BDD scenarios in code |
|
|
150
|
+
| **Daily** | No formal doc; standup covers blockers |
|
|
151
|
+
| **Sprint Review** | Demo = informal execution; bugs logged |
|
|
152
|
+
| **Sprint Retro** | Update Organizational Test Practices if needed |
|
|
153
|
+
| **Release** | Test Completion Report (1-page) if release sign-off required |
|
|
154
|
+
|
|
155
|
+
### Definition of Done (Testing)
|
|
156
|
+
|
|
157
|
+
Include in DoD:
|
|
158
|
+
- [ ] Test cases written for new/changed features
|
|
159
|
+
- [ ] Automated tests in pipeline where applicable
|
|
160
|
+
- [ ] No critical/high bugs open for release scope
|
|
161
|
+
- [ ] Test execution logged (CI or manual log)
|
|
162
|
+
- [ ] Traceability: requirement → test case
|
|
163
|
+
|
|
164
|
+
### Definition of Ready (Testing)
|
|
165
|
+
|
|
166
|
+
- [ ] Acceptance criteria defined
|
|
167
|
+
- [ ] Test environment available
|
|
168
|
+
- [ ] Test data identified
|
|
169
|
+
- [ ] Dependencies known
|
|
170
|
+
|
|
171
|
+
---
|
|
172
|
+
|
|
173
|
+
## DevOps-Specific Patterns
|
|
174
|
+
|
|
175
|
+
### Pipeline as Documentation
|
|
176
|
+
|
|
177
|
+
- **Test Plan** → Quality gates in pipeline (e.g., 80% pass, no critical failures)
|
|
178
|
+
- **Test Procedure** → Test code
|
|
179
|
+
- **Execution Log** → CI run logs, Allure report
|
|
180
|
+
- **Incident Report** → Bug created from failed test; auto-link
|
|
181
|
+
|
|
182
|
+
### Quality Gates
|
|
183
|
+
|
|
184
|
+
Define in pipeline config:
|
|
185
|
+
- Unit test pass rate
|
|
186
|
+
- Integration test pass rate
|
|
187
|
+
- Coverage threshold
|
|
188
|
+
- Security scan (OWASP, Snyk)
|
|
189
|
+
- Performance baseline (optional)
|
|
190
|
+
|
|
191
|
+
### Dashboards
|
|
192
|
+
|
|
193
|
+
Replace Test Status Report with:
|
|
194
|
+
- Pass/fail trend
|
|
195
|
+
- Coverage trend
|
|
196
|
+
- Open bugs by severity
|
|
197
|
+
- Deployment frequency
|
|
198
|
+
- Mean time to recovery (MTTR)
|
|
199
|
+
|
|
200
|
+
---
|
|
201
|
+
|
|
202
|
+
## Checklist: Applying Tailoring
|
|
203
|
+
|
|
204
|
+
- [ ] Context identified: Agile / Scrum / DevOps / Hybrid
|
|
205
|
+
- [ ] Document set chosen: Minimal / Hybrid / Full
|
|
206
|
+
- [ ] Merged documents listed (e.g., "Test Plan + Level Plans → single doc")
|
|
207
|
+
- [ ] Omitted sections documented (e.g., "Readiness reports omitted; checklist in Confluence")
|
|
208
|
+
- [ ] Tool integration specified (Jira, Zephyr, CI, etc.)
|
|
209
|
+
- [ ] Traceability preserved (requirement → test case → execution → incident)
|
|
210
|
+
- [ ] Stakeholder sign-off approach defined (async, PO, formal)
|
|
211
|
+
- [ ] Review cadence set (sprint, release, quarterly)
|
|
212
|
+
|
|
213
|
+
---
|
|
214
|
+
|
|
215
|
+
## When NOT to Over-Tailor
|
|
216
|
+
|
|
217
|
+
- **Regulated domains** (medical, finance, aviation): Keep formal documents; tailor format, not content.
|
|
218
|
+
- **Contractual requirements**: Customer may require specific ISO documents; confirm before omitting.
|
|
219
|
+
- **Audit trail**: If audits occur, ensure tool exports or generated reports satisfy auditors.
|
|
220
|
+
- **Distributed teams**: Slightly more documentation helps remote collaboration.
|
|
@@ -0,0 +1,302 @@
|
|
|
1
|
+
# ISO/IEC/IEEE 29119-3 Document Types Reference
|
|
2
|
+
|
|
3
|
+
*Per ISO/IEC/IEEE 29119-3:2021 — Software and systems engineering — Software testing — Part 3: Test documentation*
|
|
4
|
+
|
|
5
|
+
## Document Hierarchy
|
|
6
|
+
|
|
7
|
+
```
|
|
8
|
+
Test Policy
|
|
9
|
+
└── Organizational Test Practices
|
|
10
|
+
└── Project Test Plan
|
|
11
|
+
├── Level Test Plans (unit/integration/system/acceptance)
|
|
12
|
+
├── Type Test Plans (functional/performance/security)
|
|
13
|
+
└── Test Specifications
|
|
14
|
+
├── Test Model Specification
|
|
15
|
+
├── Test Case Specification
|
|
16
|
+
└── Test Procedure Specification
|
|
17
|
+
```
|
|
18
|
+
|
|
19
|
+
---
|
|
20
|
+
|
|
21
|
+
## Governance Documents
|
|
22
|
+
|
|
23
|
+
### Test Policy
|
|
24
|
+
|
|
25
|
+
**Purpose:** High-level organizational commitment to testing. Defines testing objectives, principles, and governance.
|
|
26
|
+
|
|
27
|
+
| Section | Mandatory | Recommended | Description |
|
|
28
|
+
|---------|-----------|-------------|-------------|
|
|
29
|
+
| Purpose | ✓ | | Why the policy exists |
|
|
30
|
+
| Scope | ✓ | | Organizational scope |
|
|
31
|
+
| Testing objectives | ✓ | | High-level goals |
|
|
32
|
+
| Testing principles | | ✓ | Guiding principles |
|
|
33
|
+
| Roles and responsibilities | | ✓ | Who governs testing |
|
|
34
|
+
| References | | ✓ | Related standards, policies |
|
|
35
|
+
|
|
36
|
+
---
|
|
37
|
+
|
|
38
|
+
### Organizational Test Practices
|
|
39
|
+
|
|
40
|
+
**Purpose:** Describes how the organization implements testing. Operationalizes the Test Policy.
|
|
41
|
+
|
|
42
|
+
| Section | Mandatory | Recommended | Description |
|
|
43
|
+
|---------|-----------|-------------|-------------|
|
|
44
|
+
| Purpose | ✓ | | Purpose of the practices |
|
|
45
|
+
| Scope | ✓ | | Applicability |
|
|
46
|
+
| Test process description | ✓ | | How testing is performed |
|
|
47
|
+
| Test documentation practices | ✓ | | Which documents are used |
|
|
48
|
+
| Test environment management | | ✓ | Environment setup and control |
|
|
49
|
+
| Test data management | | ✓ | Data creation, masking, retention |
|
|
50
|
+
| Tools and automation | | ✓ | Tool strategy |
|
|
51
|
+
| References | | ✓ | Test Policy, standards |
|
|
52
|
+
|
|
53
|
+
---
|
|
54
|
+
|
|
55
|
+
## Planning Documents
|
|
56
|
+
|
|
57
|
+
### Project Test Plan
|
|
58
|
+
|
|
59
|
+
**Purpose:** Describes the testing approach for a specific project. May be decomposed into Level and Type Test Plans.
|
|
60
|
+
|
|
61
|
+
| Section | Mandatory | Recommended | Description |
|
|
62
|
+
|---------|-----------|-------------|-------------|
|
|
63
|
+
| Introduction | ✓ | | Purpose, scope, definitions |
|
|
64
|
+
| Test items | ✓ | | Features to test, features not to test |
|
|
65
|
+
| Test approach | ✓ | | Strategy per level/type |
|
|
66
|
+
| Pass/fail criteria | ✓ | | Measurable criteria |
|
|
67
|
+
| Entry criteria | ✓ | | Conditions to start testing |
|
|
68
|
+
| Exit criteria | ✓ | | Conditions to complete testing |
|
|
69
|
+
| Suspension/resumption | ✓ | | When to halt/resume |
|
|
70
|
+
| Deliverables | ✓ | | Expected artifacts |
|
|
71
|
+
| Test environment | ✓ | | Environment requirements |
|
|
72
|
+
| Schedule | ✓ | | Timeline, milestones |
|
|
73
|
+
| Staffing | ✓ | | Roles, responsibilities |
|
|
74
|
+
| Risks and contingencies | | ✓ | Risks and mitigations |
|
|
75
|
+
| Approvals | | ✓ | Sign-off table |
|
|
76
|
+
|
|
77
|
+
---
|
|
78
|
+
|
|
79
|
+
### Level Test Plans
|
|
80
|
+
|
|
81
|
+
**Purpose:** Plans for a specific test level (unit, integration, system, acceptance).
|
|
82
|
+
|
|
83
|
+
| Level | Description |
|
|
84
|
+
|-------|-------------|
|
|
85
|
+
| **Unit** | Component-level testing |
|
|
86
|
+
| **Integration** | Interface and interaction testing |
|
|
87
|
+
| **System** | End-to-end system testing |
|
|
88
|
+
| **Acceptance** | User/business acceptance |
|
|
89
|
+
|
|
90
|
+
**Sections:** Same structure as Project Test Plan, scoped to the level. May reference parent Project Test Plan for shared elements.
|
|
91
|
+
|
|
92
|
+
---
|
|
93
|
+
|
|
94
|
+
### Type Test Plans
|
|
95
|
+
|
|
96
|
+
**Purpose:** Plans for a specific test type (functional, performance, security, etc.).
|
|
97
|
+
|
|
98
|
+
| Type | Description |
|
|
99
|
+
|------|-------------|
|
|
100
|
+
| **Functional** | Functional behavior verification |
|
|
101
|
+
| **Performance** | Load, stress, scalability |
|
|
102
|
+
| **Security** | Security vulnerabilities, OWASP |
|
|
103
|
+
| **Usability** | UX, accessibility (WCAG) |
|
|
104
|
+
| **Compatibility** | Browsers, devices, OS |
|
|
105
|
+
|
|
106
|
+
**Sections:** Same structure as Project Test Plan, scoped to the type. May reference NFR criteria from qa-nfr-analyst.
|
|
107
|
+
|
|
108
|
+
---
|
|
109
|
+
|
|
110
|
+
## Specification Documents
|
|
111
|
+
|
|
112
|
+
### Test Model Specification
|
|
113
|
+
|
|
114
|
+
**Purpose:** Describes test models used to derive test cases. Replaces "test conditions" in ISO 29119-3:2021. Models include state diagrams, decision tables, equivalence classes, boundary values.
|
|
115
|
+
|
|
116
|
+
| Section | Mandatory | Recommended | Description |
|
|
117
|
+
|---------|-----------|-------------|-------------|
|
|
118
|
+
| Identifier | ✓ | | Unique ID (e.g., TMS-001) |
|
|
119
|
+
| Purpose | ✓ | | Purpose of the model |
|
|
120
|
+
| Scope | ✓ | | What the model covers |
|
|
121
|
+
| Model description | ✓ | | Model content (diagram, table, etc.) |
|
|
122
|
+
| Traceability | ✓ | | Links to requirements |
|
|
123
|
+
| References | | ✓ | Source requirements, specs |
|
|
124
|
+
|
|
125
|
+
---
|
|
126
|
+
|
|
127
|
+
### Test Case Specification
|
|
128
|
+
|
|
129
|
+
**Purpose:** Defines individual test cases derived from test models.
|
|
130
|
+
|
|
131
|
+
| Section | Mandatory | Recommended | Description |
|
|
132
|
+
|---------|-----------|-------------|-------------|
|
|
133
|
+
| Identifier | ✓ | | Unique ID (e.g., TC-001) |
|
|
134
|
+
| Purpose | ✓ | | Purpose of the test case |
|
|
135
|
+
| Preconditions | ✓ | | Prerequisites |
|
|
136
|
+
| Input specifications | ✓ | | Test inputs |
|
|
137
|
+
| Expected results | ✓ | | Expected outcomes |
|
|
138
|
+
| Postconditions | | ✓ | State after execution |
|
|
139
|
+
| Traceability | ✓ | | Links to test model, requirements |
|
|
140
|
+
| Priority | | ✓ | Priority level |
|
|
141
|
+
|
|
142
|
+
---
|
|
143
|
+
|
|
144
|
+
### Test Procedure Specification
|
|
145
|
+
|
|
146
|
+
**Purpose:** Step-by-step instructions for executing test cases.
|
|
147
|
+
|
|
148
|
+
| Section | Mandatory | Recommended | Description |
|
|
149
|
+
|---------|-----------|-------------|-------------|
|
|
150
|
+
| Identifier | ✓ | | Unique ID (e.g., TPS-001) |
|
|
151
|
+
| Purpose | ✓ | | Purpose of the procedure |
|
|
152
|
+
| Test cases covered | ✓ | | TC-001, TC-002, ... |
|
|
153
|
+
| Prerequisites | ✓ | | Setup requirements |
|
|
154
|
+
| Procedure steps | ✓ | | Numbered steps |
|
|
155
|
+
| Expected results per step | | ✓ | Per-step expectations |
|
|
156
|
+
| Traceability | ✓ | | Links to test cases |
|
|
157
|
+
|
|
158
|
+
---
|
|
159
|
+
|
|
160
|
+
## Execution Documents
|
|
161
|
+
|
|
162
|
+
### Test Execution Log
|
|
163
|
+
|
|
164
|
+
**Purpose:** Records the execution of test procedures. Captures date, tester, result, actual vs expected.
|
|
165
|
+
|
|
166
|
+
| Section | Mandatory | Recommended | Description |
|
|
167
|
+
|---------|-----------|-------------|-------------|
|
|
168
|
+
| Identifier | ✓ | | Log ID |
|
|
169
|
+
| Test procedure | ✓ | | TPS reference |
|
|
170
|
+
| Execution date/time | ✓ | | When executed |
|
|
171
|
+
| Tester | ✓ | | Who executed |
|
|
172
|
+
| Result | ✓ | | Pass/Fail/Blocked/Skipped |
|
|
173
|
+
| Actual results | ✓ | | What was observed |
|
|
174
|
+
| Environment/build | | ✓ | SUT version, build ID |
|
|
175
|
+
| Evidence | | ✓ | Screenshots, logs |
|
|
176
|
+
|
|
177
|
+
---
|
|
178
|
+
|
|
179
|
+
### Test Incident Report (Bug Report / Defect Report)
|
|
180
|
+
|
|
181
|
+
**Purpose:** Records deviations between expected and actual results. Synonymous with bug report, defect report.
|
|
182
|
+
|
|
183
|
+
| Section | Mandatory | Recommended | Description |
|
|
184
|
+
|---------|-----------|-------------|-------------|
|
|
185
|
+
| Identifier | ✓ | | Unique ID (e.g., TIR-001) |
|
|
186
|
+
| Summary | ✓ | | Brief description |
|
|
187
|
+
| Test case/procedure | ✓ | | Which test failed |
|
|
188
|
+
| Expected result | ✓ | | What was expected |
|
|
189
|
+
| Actual result | ✓ | | What occurred |
|
|
190
|
+
| Steps to reproduce | ✓ | | How to reproduce |
|
|
191
|
+
| Severity/priority | | ✓ | Impact and urgency |
|
|
192
|
+
| Status | | ✓ | Open, fixed, deferred |
|
|
193
|
+
| Environment | | ✓ | Build, OS, browser |
|
|
194
|
+
| Evidence | | ✓ | Attachments |
|
|
195
|
+
|
|
196
|
+
---
|
|
197
|
+
|
|
198
|
+
## Reporting Documents
|
|
199
|
+
|
|
200
|
+
### Test Status Report
|
|
201
|
+
|
|
202
|
+
**Purpose:** Periodic progress report during test execution.
|
|
203
|
+
|
|
204
|
+
| Section | Mandatory | Recommended | Description |
|
|
205
|
+
|---------|-----------|-------------|-------------|
|
|
206
|
+
| Identifier | ✓ | | Report ID |
|
|
207
|
+
| Reporting period | ✓ | | Date range |
|
|
208
|
+
| Summary | ✓ | | Executive summary |
|
|
209
|
+
| Test execution summary | ✓ | | Pass/fail/blocked counts |
|
|
210
|
+
| Incidents | ✓ | | Open/closed incident summary |
|
|
211
|
+
| Risks and issues | | ✓ | Blockers, risks |
|
|
212
|
+
| Next period plan | | ✓ | Planned activities |
|
|
213
|
+
| Metrics | | ✓ | Coverage, progress % |
|
|
214
|
+
|
|
215
|
+
---
|
|
216
|
+
|
|
217
|
+
### Test Completion Report
|
|
218
|
+
|
|
219
|
+
**Purpose:** Final report when testing is complete. Summarizes outcomes and recommendations.
|
|
220
|
+
|
|
221
|
+
| Section | Mandatory | Recommended | Description |
|
|
222
|
+
|---------|-----------|-------------|-------------|
|
|
223
|
+
| Identifier | ✓ | | Report ID |
|
|
224
|
+
| Summary | ✓ | | Executive summary |
|
|
225
|
+
| Test execution summary | ✓ | | Final pass/fail/blocked counts |
|
|
226
|
+
| Exit criteria met | ✓ | | Whether criteria were satisfied |
|
|
227
|
+
| Incidents summary | ✓ | | Open, closed, deferred |
|
|
228
|
+
| Recommendations | ✓ | | Release readiness, follow-up |
|
|
229
|
+
| Lessons learned | | ✓ | Process improvements |
|
|
230
|
+
| Metrics | | ✓ | Coverage, defect density |
|
|
231
|
+
|
|
232
|
+
---
|
|
233
|
+
|
|
234
|
+
## Readiness Documents
|
|
235
|
+
|
|
236
|
+
### Test Data Requirements
|
|
237
|
+
|
|
238
|
+
**Purpose:** Specifies data needed for testing.
|
|
239
|
+
|
|
240
|
+
| Section | Mandatory | Recommended | Description |
|
|
241
|
+
|---------|-----------|-------------|-------------|
|
|
242
|
+
| Identifier | ✓ | | Document ID |
|
|
243
|
+
| Purpose | ✓ | | Purpose of the data |
|
|
244
|
+
| Data requirements | ✓ | | Types, volumes, characteristics |
|
|
245
|
+
| Data sources | | ✓ | Where data comes from |
|
|
246
|
+
| Privacy/security | | ✓ | Masking, anonymization |
|
|
247
|
+
| Traceability | | ✓ | Links to test cases |
|
|
248
|
+
|
|
249
|
+
---
|
|
250
|
+
|
|
251
|
+
### Test Environment Requirements
|
|
252
|
+
|
|
253
|
+
**Purpose:** Specifies environment needed for testing.
|
|
254
|
+
|
|
255
|
+
| Section | Mandatory | Recommended | Description |
|
|
256
|
+
|---------|-----------|-------------|-------------|
|
|
257
|
+
| Identifier | ✓ | | Document ID |
|
|
258
|
+
| Purpose | ✓ | | Purpose of the environment |
|
|
259
|
+
| Hardware | ✓ | | Servers, devices |
|
|
260
|
+
| Software | ✓ | | OS, middleware, tools |
|
|
261
|
+
| Network | | ✓ | Connectivity requirements |
|
|
262
|
+
| Access/credentials | | ✓ | Access requirements (no secrets) |
|
|
263
|
+
| Traceability | | ✓ | Links to test plans |
|
|
264
|
+
|
|
265
|
+
---
|
|
266
|
+
|
|
267
|
+
### Test Data Readiness Report
|
|
268
|
+
|
|
269
|
+
**Purpose:** Confirms test data is ready for use.
|
|
270
|
+
|
|
271
|
+
| Section | Mandatory | Recommended | Description |
|
|
272
|
+
|---------|-----------|-------------|-------------|
|
|
273
|
+
| Identifier | ✓ | | Report ID |
|
|
274
|
+
| Status | ✓ | | Ready/Not ready |
|
|
275
|
+
| Data sets | ✓ | | What was prepared |
|
|
276
|
+
| Gaps | | ✓ | Missing or incomplete data |
|
|
277
|
+
| Traceability | | ✓ | Links to Test Data Requirements |
|
|
278
|
+
|
|
279
|
+
---
|
|
280
|
+
|
|
281
|
+
### Test Environment Readiness Report
|
|
282
|
+
|
|
283
|
+
**Purpose:** Confirms test environment is ready for use.
|
|
284
|
+
|
|
285
|
+
| Section | Mandatory | Recommended | Description |
|
|
286
|
+
|---------|-----------|-------------|-------------|
|
|
287
|
+
| Identifier | ✓ | | Report ID |
|
|
288
|
+
| Status | ✓ | | Ready/Not ready |
|
|
289
|
+
| Components | ✓ | | What was set up |
|
|
290
|
+
| Gaps | | ✓ | Missing or incomplete components |
|
|
291
|
+
| Traceability | | ✓ | Links to Test Environment Requirements |
|
|
292
|
+
|
|
293
|
+
---
|
|
294
|
+
|
|
295
|
+
## Information Element Necessity
|
|
296
|
+
|
|
297
|
+
ISO 29119-3 classifies each information element as:
|
|
298
|
+
- **Mandatory** — Must be present
|
|
299
|
+
- **Recommended** — Should be present unless tailored out
|
|
300
|
+
- **Possible** — Optional, include when useful
|
|
301
|
+
|
|
302
|
+
Tailoring is permitted; document which elements are omitted and why.
|