qualiow-exploratory-testing 1.3.0 → 2.2.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude-plugin/marketplace.json +26 -0
- package/.claude-plugin/plugin.json +22 -0
- package/.env.example +27 -0
- package/CHANGELOG.md +259 -0
- package/README.md +472 -204
- package/agents/qa-diff-indexer-agent.md +81 -0
- package/agents/qa-gather-agent.md +41 -0
- package/agents/qa-page-mapper-agent.md +74 -0
- package/agents/qa-reporting-agent.md +103 -0
- package/{scripts → bin}/doctor-mobile.sh +57 -18
- package/bin/mcli +15 -9
- package/bin/mobile-cli.mjs +574 -286
- package/bin/qualiow +30 -0
- package/{scripts → bin}/setup-mobile.sh +56 -19
- package/bin/wadb +10 -4
- package/bin/wk-ios +29 -17
- package/bin/wkeval.mjs +7 -1
- package/data/domains/_default.yml +1 -1
- package/data/knowledge/changelog.yml +30 -12
- package/data/knowledge/manifest.yml +355 -127
- package/data/knowledge/releases/v0.1.0/entries/technique-business-logic-race-conditions.yml +1 -1
- package/data/knowledge/releases/v0.1.0/release.yml +8 -1
- package/data/knowledge/releases/v0.6.0/entries/technique-async-callback-contracts.yml +98 -0
- package/data/knowledge/releases/v0.6.0/entries/technique-exactly-once-verification.yml +116 -0
- package/data/knowledge/releases/v0.6.0/release.yml +30 -0
- package/data/security/SECURITY-POLICY.md +273 -0
- package/data/targets/_default.yml +1 -1
- package/data/targets/_example-api-only.yml +80 -0
- package/data/targets/_example-mobile-emulation.yml +2 -2
- package/data/targets/_example-native-mobile.yml +2 -2
- package/data/targets/_example-sim-android-chrome.yml +1 -1
- package/data/targets/_example-sim-ios-safari.yml +1 -1
- package/data/templates/api-probe-matrix.md +3 -3
- package/data/templates/bug-report.md +29 -151
- package/data/templates/coverage-map.md +9 -6
- package/data/templates/expected-behaviour.md +3 -2
- package/data/templates/session-charter.md +3 -0
- package/data/templates/session-report.md +57 -80
- package/dist/cli/index.js +2286 -701
- package/dist/index.d.ts +637 -81
- package/dist/index.js +2058 -228
- package/docs/BACKEND-VERIFICATION.md +39 -9
- package/docs/GETTING-STARTED.md +300 -121
- package/docs/MOBILE-SETUP.md +149 -18
- package/hooks/hooks.json +27 -0
- package/hooks/scripts/read-guard.mjs +95 -0
- package/hooks/scripts/secret-patterns.d.mts +8 -0
- package/hooks/scripts/secret-patterns.mjs +136 -0
- package/hooks/scripts/write-guard.mjs +87 -0
- package/package.json +33 -18
- package/skills/qa-explore/SKILL.md +32 -25
- package/skills/qa-explore/phases/00-setup.md +76 -42
- package/skills/qa-explore/phases/01-auth.md +32 -15
- package/skills/qa-explore/phases/02-charter.md +16 -5
- package/skills/qa-explore/phases/03-discovery.md +93 -27
- package/skills/qa-explore/phases/04-journeys.md +2 -2
- package/skills/qa-explore/phases/05-features.md +39 -24
- package/skills/qa-explore/phases/06-edge-cases.md +24 -13
- package/skills/qa-explore/phases/07-reporting.md +102 -142
- package/skills/qa-explore/references/context-integration.md +1 -1
- package/skills/qa-explore/references/delegation-rules.md +82 -0
- package/skills/qa-explore/references/output-contract.md +192 -0
- package/skills/qa-explore/references/paths.md +108 -0
- package/skills/qa-explore/references/playwright-agents-integration.md +61 -84
- package/skills/qa-explore/references/security-rules.md +70 -25
- package/skills/qa-explore/references/session-rules.md +2 -1
- package/skills/qa-explore/references/severity-guide.md +31 -4
- package/skills/qa-explore-cleanup/SKILL.md +51 -15
- package/skills/qa-explore-feedback/SKILL.md +23 -5
- package/skills/qa-explore-mobile/SKILL.md +86 -64
- package/skills/qa-explore-mobile/phases/00-setup.md +71 -62
- package/skills/qa-explore-mobile/phases/01-auth.md +28 -31
- package/skills/qa-explore-mobile/phases/02-charter.md +8 -4
- package/skills/qa-explore-mobile/phases/03-discovery.md +17 -11
- package/skills/qa-explore-mobile/phases/04-journeys.md +6 -6
- package/skills/qa-explore-mobile/phases/05-features.md +9 -9
- package/skills/qa-explore-mobile/phases/06-edge-cases.md +35 -40
- package/skills/qa-explore-mobile/phases/07-reporting.md +108 -60
- package/skills/qa-explore-mobile/references/mobile-edges.md +26 -26
- package/skills/qa-explore-quick/SKILL.md +71 -26
- package/skills/qa-explore-report/SKILL.md +65 -35
- package/skills/qa-gather/SKILL.md +44 -8
- package/skills/qa-knowledge-add/SKILL.md +25 -9
- package/skills/qa-knowledge-list/SKILL.md +37 -40
- package/skills/qa-target-setup/SKILL.md +63 -41
- package/skills/qa-verify-backend/SKILL.md +31 -19
- package/skills/qa-verify-backend/phases/00-setup.md +57 -12
- package/skills/qa-verify-backend/phases/01-ac-decomposition.md +2 -2
- package/skills/qa-verify-backend/phases/02-static-review.md +11 -0
- package/skills/qa-verify-backend/phases/03-live-verification.md +5 -3
- package/skills/qa-verify-backend/phases/03b-api-verification.md +24 -9
- package/skills/qa-verify-backend/phases/04-e2e-trigger.md +18 -2
- package/skills/qa-verify-backend/phases/05-reporting.md +72 -12
- package/skills/qa-verify-backend/references/api-probes.md +28 -1
- package/skills/qa-verify-backend/references/payload-verification.md +1 -1
- package/skills/qa-verify-backend/references/release-readiness.md +1 -1
- package/skills/qa-verify-backend/references/safety-rules.md +13 -8
- package/data/domains/_default.md +0 -181
- package/data/domains/ecommerce.md +0 -192
- package/data/domains/fintech.md +0 -200
- package/data/domains/identity.md +0 -88
- package/data/domains/marketing.md +0 -194
- package/data/domains/saas.md +0 -197
- package/dist/cli/index.d.ts +0 -1
- package/dist/cli/index.js.map +0 -1
- package/dist/index.js.map +0 -1
|
@@ -1,7 +1,7 @@
|
|
|
1
|
-
|
|
1
|
+
> CONFIDENTIAL: This report may contain internal URLs, security vulnerabilities,
|
|
2
|
+
> and application details. Do not share outside your organization without review.
|
|
2
3
|
|
|
3
|
-
|
|
4
|
-
> configuration. Keep local. Redact response bodies before saving.
|
|
4
|
+
# API Probe Matrix
|
|
5
5
|
|
|
6
6
|
## Session Reference
|
|
7
7
|
|
|
@@ -1,178 +1,56 @@
|
|
|
1
|
-
|
|
1
|
+
> CONFIDENTIAL: This report may contain internal URLs, security vulnerabilities,
|
|
2
|
+
> and application details. Do not share outside your organization without review.
|
|
2
3
|
|
|
3
|
-
|
|
4
|
+
# BUG-NNN: [Component] fails [Condition] causing [Impact]
|
|
4
5
|
|
|
5
|
-
`[
|
|
6
|
+
> _Title example: `[Login Form] fails [when password contains special characters] causing [authentication error and user lockout]`. Number bugs from BUG-001 per session; one file per bug at `bugs/BUG-NNN.md`._
|
|
6
7
|
|
|
7
|
-
|
|
8
|
+
**Severity:** Critical | High | Medium | Low
|
|
9
|
+
**Priority:** P0 | P1 | P2 | P3
|
|
10
|
+
**Component:** [Component]
|
|
11
|
+
**URL:** [exact URL where the bug was found — mobile: screen name or deep link — backend: endpoint or resource]
|
|
12
|
+
**Environment:** [e.g. Playwright CLI, Chromium, 1280x720, logged in as X — mobile: mode / platform / device / OS — backend: env kind + build]
|
|
13
|
+
**Reproduction rate:** Always | Intermittent (~X%) | Once
|
|
8
14
|
|
|
9
|
-
|
|
15
|
+
> _Severity per `severity-guide.md`: Critical = data loss, security breach, financial loss, system unusable; High = major feature broken, no reasonable workaround; Medium = partial break, workaround exists, or an important missing feature; Low = cosmetic, rare edge case. **When in doubt, go one level LOWER.** Priority = severity adjusted by workaround and blast radius (P0 hours · P1 this sprint · P2 next sprint · P3 backlog)._
|
|
10
16
|
|
|
11
|
-
##
|
|
17
|
+
## Summary
|
|
12
18
|
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
- [ ] **Critical**
|
|
16
|
-
- [ ] **High**
|
|
17
|
-
- [ ] **Medium**
|
|
18
|
-
- [ ] **Low**
|
|
19
|
-
|
|
20
|
-
### Severity Level Definitions
|
|
21
|
-
|
|
22
|
-
| Level | Definition | Examples |
|
|
23
|
-
|----------|----------------------------------------------------------------------------|-----------------------------------------------------------------------------------------------|
|
|
24
|
-
| Critical | System down, data loss, security breach. Blocks all users immediately. | Payment gateway crashes on all transactions; user passwords exposed in API response; database corruption losing customer orders. |
|
|
25
|
-
| High | Major feature broken, many users affected. No reasonable workaround. | Checkout fails for all credit card payments; search returns zero results for every query; login broken on mobile devices. |
|
|
26
|
-
| Medium | Partial break, workaround exists. Some users affected under certain paths. | Discount code applies twice if user clicks fast; filter resets after pagination; profile photo upload fails on Safari only. |
|
|
27
|
-
| Low | Cosmetic issue, rare edge case. Minimal user or business impact. | Footer alignment off by 2px on wide screens; tooltip text truncated in German locale; hover state missing on disabled button. |
|
|
28
|
-
|
|
29
|
-
> **Note: When in doubt, go one level LOWER. Severity inflation destroys credibility.** A bug report rated "Critical" that turns out to be cosmetic undermines every future report you file. Reserve Critical for genuine emergencies. If you hesitate between two levels, pick the lower one and let the evidence speak for itself.
|
|
30
|
-
|
|
31
|
-
---
|
|
32
|
-
|
|
33
|
-
## URL
|
|
34
|
-
|
|
35
|
-
`[URL where the bug was found]`
|
|
36
|
-
|
|
37
|
-
## Environment
|
|
38
|
-
|
|
39
|
-
| Property | Value |
|
|
40
|
-
|-----------|---------------------------|
|
|
41
|
-
| Browser | [e.g., Chrome 125.0] |
|
|
42
|
-
| Viewport | [e.g., 1920x1080] |
|
|
43
|
-
| OS | [e.g., macOS 15.x] |
|
|
44
|
-
| Auth | [e.g., logged in as X] |
|
|
45
|
-
| Device | [e.g., Desktop / Mobile] |
|
|
46
|
-
|
|
47
|
-
---
|
|
19
|
+
[Two sentences: what breaks, and why it matters to the business.]
|
|
48
20
|
|
|
49
21
|
## Expected Behavior
|
|
50
22
|
|
|
51
|
-
|
|
52
|
-
|
|
53
|
-
> [Describe the expected outcome clearly.]
|
|
23
|
+
[What should happen according to requirements, conventions, or reasonable user expectations.]
|
|
54
24
|
|
|
55
25
|
## Actual Behavior
|
|
56
26
|
|
|
57
|
-
|
|
58
|
-
|
|
59
|
-
> [Describe the actual outcome. Be precise -- include error messages verbatim if applicable.]
|
|
60
|
-
|
|
61
|
-
---
|
|
27
|
+
[What actually happens instead. Be precise; include error messages verbatim.]
|
|
62
28
|
|
|
63
29
|
## Steps to Reproduce
|
|
64
30
|
|
|
65
31
|
1. Navigate to `[URL]`
|
|
66
32
|
2. [Action 2]
|
|
67
33
|
3. [Action 3]
|
|
68
|
-
4. [
|
|
69
|
-
5. Observe: [what goes wrong]
|
|
70
|
-
|
|
71
|
-
> _Reproduction rate: [Always / Intermittent (~X%) / Once]_
|
|
72
|
-
|
|
73
|
-
---
|
|
34
|
+
4. Observe: [what goes wrong]
|
|
74
35
|
|
|
75
36
|
## Business Impact
|
|
76
37
|
|
|
77
|
-
>
|
|
78
|
-
|
|
79
|
-
### Revenue Impact
|
|
80
|
-
|
|
81
|
-
> [Does this bug prevent purchases, cause incorrect charges, block upgrades, or reduce conversion? Quantify if possible -- e.g., "Blocks all guest checkout, which represents ~30% of orders."]
|
|
82
|
-
|
|
83
|
-
### Trust Impact
|
|
84
|
-
|
|
85
|
-
> [Would a user lose confidence in the product? Would they contact support, leave a negative review, or churn? e.g., "User sees a $0.00 balance briefly before correct amount loads -- creates panic."]
|
|
86
|
-
|
|
87
|
-
### Regulatory Risk
|
|
88
|
-
|
|
89
|
-
> [Does this violate any compliance requirements? Specify the regulation. e.g., "Credit card number visible in URL query string -- PCI DSS violation." If none, write "No known regulatory risk."]
|
|
90
|
-
>
|
|
91
|
-
> Common frameworks to consider: SOX, PCI DSS, GDPR, CCPA, HIPAA, WCAG 2.1 AA, CAN-SPAM, KYC/AML, Regulation E.
|
|
92
|
-
|
|
93
|
-
### Data Risk
|
|
94
|
-
|
|
95
|
-
> [Is data corrupted, lost, or exposed? e.g., "Order total saved as $0 in database when coupon equals cart value -- data integrity failure." If none, write "No data risk identified."]
|
|
96
|
-
|
|
97
|
-
### Scale
|
|
98
|
-
|
|
99
|
-
> [How many users are affected and under what conditions? e.g., "All users on iOS Safari 17+ (~18% of mobile traffic)" or "Only affects accounts created before the migration on 2025-01-15 (~200 accounts)."]
|
|
100
|
-
|
|
101
|
-
---
|
|
38
|
+
> _Mandatory. Answer at least one bullet; write "none identified" for the rest. Quantify where you can ("blocks all guest checkout, ~30% of orders")._
|
|
102
39
|
|
|
103
|
-
|
|
104
|
-
|
|
105
|
-
|
|
106
|
-
|
|
107
|
-
|
|
108
|
-
|-------------|------------------|----------------------------------------------------|
|
|
109
|
-
| Likelihood | High / Med / Low | [How likely is a user to hit this? Every time? Rare edge case?] |
|
|
110
|
-
| Impact | High / Med / Low | [How bad is it when they do? Data loss? Mild annoyance?] |
|
|
111
|
-
| **Risk** | **[Result]** | **Risk = Likelihood x Impact** (see matrix below) |
|
|
112
|
-
|
|
113
|
-
### Risk Matrix
|
|
114
|
-
|
|
115
|
-
| | **Impact: Low** | **Impact: Med** | **Impact: High** |
|
|
116
|
-
|--------------------|-----------------|-----------------|-------------------|
|
|
117
|
-
| **Likelihood: High** | Medium | High | Critical |
|
|
118
|
-
| **Likelihood: Med** | Low | Medium | High |
|
|
119
|
-
| **Likelihood: Low** | Low | Low | Medium |
|
|
120
|
-
|
|
121
|
-
---
|
|
122
|
-
|
|
123
|
-
## Recommended Fix Priority
|
|
124
|
-
|
|
125
|
-
> **Priority: [P0 / P1 / P2 / P3]**
|
|
126
|
-
|
|
127
|
-
| Priority | Meaning | Typical SLA |
|
|
128
|
-
|----------|--------------------------------------|----------------------|
|
|
129
|
-
| P0 | Fix immediately, interrupt sprint | Hours |
|
|
130
|
-
| P1 | Fix this sprint | Days |
|
|
131
|
-
| P2 | Fix next sprint | 1-2 weeks |
|
|
132
|
-
| P3 | Backlog, fix when convenient | When capacity allows |
|
|
133
|
-
|
|
134
|
-
**Justification:** [Explain why this priority level is appropriate given the risk assessment and business impact above. e.g., "Risk is High (likely + revenue-impacting), but a workaround exists (users can switch payment method), so P1 rather than P0."]
|
|
135
|
-
|
|
136
|
-
---
|
|
137
|
-
|
|
138
|
-
## Impact
|
|
139
|
-
|
|
140
|
-
### User Impact
|
|
141
|
-
|
|
142
|
-
> [How does this affect the end user? Can they complete their task? What is the degraded experience?]
|
|
143
|
-
|
|
144
|
-
### Business Impact Summary
|
|
145
|
-
|
|
146
|
-
> [One-sentence summary referencing the detailed Business Impact section above. e.g., "Blocks ~30% of revenue through guest checkout with no workaround."]
|
|
147
|
-
|
|
148
|
-
---
|
|
40
|
+
- **Revenue impact:** [prevents purchases, incorrect charges, blocked upgrades, reduced conversion?]
|
|
41
|
+
- **Trust impact:** [would a user lose confidence, contact support, churn?]
|
|
42
|
+
- **Regulatory risk:** [SOX, PCI DSS, GDPR, CCPA, HIPAA, WCAG 2.1 AA, KYC/AML, Regulation E — name the regulation, or "none identified"]
|
|
43
|
+
- **Data risk:** [corrupted, lost, or exposed data?]
|
|
44
|
+
- **Scale:** [how many users, under what conditions]
|
|
149
45
|
|
|
150
46
|
## Evidence
|
|
151
47
|
|
|
152
|
-
|
|
153
|
-
|
|
154
|
-
|
|
155
|
-
|
|
156
|
-
|
|
157
|
-
|
|
158
|
-
```
|
|
159
|
-
[Paste any relevant console errors here]
|
|
160
|
-
```
|
|
48
|
+
- Screenshot: `screenshots/BUG-NNN.png`
|
|
49
|
+
- Video: `videos/BUG-NNN.webm` (if recorded; `.mp4` on mobile)
|
|
50
|
+
- Log: `logs/BUG-NNN.log` (mobile) / `evidence/<file>` (backend), or "none"
|
|
51
|
+
- Console errors: [verbatim, redacted, or "none"]
|
|
52
|
+
- Network failures: [method, URL, status, response excerpt — redacted — or "none"]
|
|
161
53
|
|
|
162
|
-
|
|
163
|
-
|
|
164
|
-
```
|
|
165
|
-
[Paste any failed requests -- method, URL, status code, response body excerpt]
|
|
166
|
-
```
|
|
167
|
-
|
|
168
|
-
### Additional Logs
|
|
169
|
-
|
|
170
|
-
```
|
|
171
|
-
[Any other diagnostic output -- application logs, state dumps, etc.]
|
|
172
|
-
```
|
|
173
|
-
|
|
174
|
-
---
|
|
175
|
-
|
|
176
|
-
## Additional Context
|
|
54
|
+
## Recommended Fix Priority
|
|
177
55
|
|
|
178
|
-
|
|
56
|
+
[Why this priority relative to the other findings: risk (likelihood × impact, see `severity-guide.md`), workaround, blast radius, and anything related — recent deploys, feature flags, user reports.]
|
|
@@ -1,10 +1,13 @@
|
|
|
1
|
+
> CONFIDENTIAL: This report may contain internal URLs, security vulnerabilities,
|
|
2
|
+
> and application details. Do not share outside your organization without review.
|
|
3
|
+
|
|
1
4
|
# Coverage Map
|
|
2
5
|
|
|
3
6
|
## Session Reference
|
|
4
7
|
|
|
5
8
|
| Property | Value |
|
|
6
9
|
|------------|--------------------------------|
|
|
7
|
-
| Session ID | [e.g
|
|
10
|
+
| Session ID | [session directory, e.g. 2026-09-08-1420-explore-parabank] |
|
|
8
11
|
| Target | [application or feature name] |
|
|
9
12
|
| Date | [YYYY-MM-DD] |
|
|
10
13
|
|
|
@@ -12,11 +15,11 @@
|
|
|
12
15
|
|
|
13
16
|
## Overall Coverage
|
|
14
17
|
|
|
15
|
-
| Area |
|
|
16
|
-
|
|
17
|
-
| [Area 1] |
|
|
18
|
-
| [Area 2] |
|
|
19
|
-
| [Area 3] |
|
|
18
|
+
| Area | Risk | Status | Bugs | Notes |
|
|
19
|
+
|---|---|---|---|---|
|
|
20
|
+
| [Area 1] | P0 | tested | 0 | [heuristics applied, notes] |
|
|
21
|
+
| [Area 2] | P1 | partial | 0 | [what was not reached and why] |
|
|
22
|
+
| [Area 3] | P2 | not-tested | — | [reason] |
|
|
20
23
|
|
|
21
24
|
### Status Legend
|
|
22
25
|
|
|
@@ -1,6 +1,7 @@
|
|
|
1
|
-
|
|
1
|
+
> CONFIDENTIAL: This report may contain internal URLs, security vulnerabilities,
|
|
2
|
+
> and application details. Do not share outside your organization without review.
|
|
2
3
|
|
|
3
|
-
|
|
4
|
+
# Expected Behaviour Specification
|
|
4
5
|
|
|
5
6
|
Use this when a verification session finds behaviour nobody wrote an acceptance criterion
|
|
6
7
|
for — which is most of what an API probe turns up. A bug report says *this is wrong*. This
|
|
@@ -1,112 +1,89 @@
|
|
|
1
|
-
|
|
1
|
+
> CONFIDENTIAL: This report may contain internal URLs, security vulnerabilities,
|
|
2
|
+
> and application details. Do not share outside your organization without review.
|
|
2
3
|
|
|
3
|
-
|
|
4
|
-
|
|
5
|
-
| Property | Value |
|
|
6
|
-
|------------|--------------------------------|
|
|
7
|
-
| Session ID | [e.g., SESSION-2026-03-28-001] |
|
|
8
|
-
| Target | [application or feature name] |
|
|
9
|
-
| URL | [target URL] |
|
|
10
|
-
| Date | [YYYY-MM-DD] |
|
|
11
|
-
| Duration | [e.g., 45 minutes] |
|
|
12
|
-
| Tester | Claude AI |
|
|
13
|
-
| Charter | [link to charter file] |
|
|
4
|
+
# Session Report — [target]
|
|
14
5
|
|
|
15
|
-
|
|
6
|
+
## Session Metadata
|
|
16
7
|
|
|
17
|
-
|
|
8
|
+
| Field | Value |
|
|
9
|
+
|---|---|
|
|
10
|
+
| Session ID | [session directory, e.g. 2026-09-08-1420-explore-parabank] |
|
|
11
|
+
| Kind | explore / quick / mobile / backend |
|
|
12
|
+
| Target | [target id or application name] |
|
|
13
|
+
| URL | [base URL] |
|
|
14
|
+
| Date | [YYYY-MM-DD] |
|
|
15
|
+
| Duration | [N] min |
|
|
16
|
+
| Charter | charter.md |
|
|
18
17
|
|
|
19
|
-
|
|
18
|
+
## Executive Summary
|
|
20
19
|
|
|
21
|
-
|
|
20
|
+
[Three sentences: what was tested, what was found, and the biggest risk.]
|
|
22
21
|
|
|
23
22
|
## Summary Stats
|
|
24
23
|
|
|
25
|
-
| Metric
|
|
26
|
-
|
|
27
|
-
| Pages
|
|
28
|
-
| Actions
|
|
29
|
-
| Bugs
|
|
30
|
-
| Bugs
|
|
31
|
-
| Bugs
|
|
32
|
-
| Bugs
|
|
33
|
-
| **Total
|
|
34
|
-
|
|
35
|
-
---
|
|
24
|
+
| Metric | Count |
|
|
25
|
+
|---|---|
|
|
26
|
+
| Pages explored | 0 |
|
|
27
|
+
| Actions performed | 0 |
|
|
28
|
+
| Bugs — Critical | 0 |
|
|
29
|
+
| Bugs — High | 0 |
|
|
30
|
+
| Bugs — Medium | 0 |
|
|
31
|
+
| Bugs — Low | 0 |
|
|
32
|
+
| **Total bugs** | **0** |
|
|
36
33
|
|
|
37
34
|
## Coverage Map
|
|
38
35
|
|
|
39
|
-
|
|
36
|
+
| Area | Risk | Status | Bugs | Notes |
|
|
37
|
+
|---|---|---|---|---|
|
|
38
|
+
| [Area 1] | P0 | tested | 0 | [notes] |
|
|
39
|
+
| [Area 2] | P1 | partial | 0 | [what was not reached and why] |
|
|
40
|
+
| [Area 3] | P2 | not-tested | — | [reason] |
|
|
40
41
|
|
|
41
|
-
|
|
42
|
-
|------|--------|--------------------|------------|-------|
|
|
43
|
-
| [Area 1] | tested / partial / not-tested | [list] | 0 | [notes] |
|
|
44
|
-
| [Area 2] | tested / partial / not-tested | [list] | 0 | [notes] |
|
|
45
|
-
| [Area 3] | tested / partial / not-tested | [list] | 0 | [notes] |
|
|
46
|
-
|
|
47
|
-
---
|
|
42
|
+
_Status: `tested` (fully explored with the planned heuristics) · `partial` (visited, not all heuristics or paths exercised) · `not-tested` (in scope, not reached) · `code-verified-only` (believed correct from reading source, never observed running: this is UNVERIFIABLE, not a pass). Name the single not-tested item that carries the most risk._
|
|
48
43
|
|
|
49
44
|
## Bugs Found
|
|
50
45
|
|
|
51
|
-
_Each bug links to its individual report in `output/bugs/`._
|
|
52
|
-
|
|
53
46
|
| # | ID | Title | Severity | Report |
|
|
54
|
-
|
|
55
|
-
| 1 |
|
|
47
|
+
|---|---|---|---|---|
|
|
48
|
+
| 1 | BUG-001 | [Component] fails [Condition] causing [Impact] | Critical/High/Medium/Low | bugs/BUG-001.md |
|
|
56
49
|
|
|
57
|
-
|
|
58
|
-
|
|
59
|
-
---
|
|
50
|
+
_If no bugs were found, state: "No bugs were found during this session."_
|
|
60
51
|
|
|
61
52
|
## Observations
|
|
62
53
|
|
|
63
|
-
_Things noticed
|
|
64
|
-
|
|
65
|
-
- [Observation 1 -- e.g., page load time felt slow on dashboard but did not exceed threshold]
|
|
66
|
-
- [Observation 2 -- e.g., tooltip text seems inconsistent with other similar features]
|
|
67
|
-
- [Observation 3]
|
|
54
|
+
_Things noticed that are not bugs but may be worth discussing: what's MISSING against the domain checklist, data-integrity results, questions for the team._
|
|
68
55
|
|
|
69
|
-
|
|
70
|
-
|
|
71
|
-
## Questions
|
|
72
|
-
|
|
73
|
-
_Unclear behaviors that need human review to determine if they are bugs or intended._
|
|
74
|
-
|
|
75
|
-
- [ ] [Question 1 -- e.g., Is the empty state message on /reports intentional when no data exists?]
|
|
76
|
-
- [ ] [Question 2 -- e.g., Should the "Save" button remain enabled when no changes have been made?]
|
|
77
|
-
- [ ] [Question 3]
|
|
78
|
-
|
|
79
|
-
---
|
|
56
|
+
- [Observation 1]
|
|
57
|
+
- [ ] [Question 1 — unclear behaviour that needs a human to decide whether it is a bug]
|
|
80
58
|
|
|
81
59
|
## Areas Not Tested
|
|
82
60
|
|
|
83
|
-
_Parts of the charter or scope that were not covered, with reasons._
|
|
84
|
-
|
|
85
61
|
| Area | Reason |
|
|
86
|
-
|
|
87
|
-
| [Area 1] | [e.g
|
|
88
|
-
| [Area 2] | [e.g
|
|
89
|
-
| [Area 3] | [e.g., Feature not yet deployed to test environment] |
|
|
90
|
-
|
|
91
|
-
---
|
|
62
|
+
|---|---|
|
|
63
|
+
| [Area 1] | [e.g. blocked by authentication issue] |
|
|
64
|
+
| [Area 2] | [e.g. time box expired before reaching this area] |
|
|
92
65
|
|
|
93
66
|
## Recommendations
|
|
94
67
|
|
|
95
|
-
|
|
96
|
-
|
|
97
|
-
- [ ] [Recommendation 1 -- e.g., Deep-dive into payment flow edge cases]
|
|
98
|
-
- [ ] [Recommendation 2 -- e.g., Regression test the login form after fix for BUG-001]
|
|
99
|
-
- [ ] [Recommendation 3 -- e.g., Cross-browser testing on Safari for the dashboard]
|
|
68
|
+
- [ ] [Recommendation 1 — e.g. deep-dive into payment-flow edge cases]
|
|
69
|
+
- [ ] [Recommendation 2 — e.g. regression-test the login form after the fix for BUG-001]
|
|
100
70
|
|
|
101
|
-
|
|
71
|
+
## Reflection
|
|
102
72
|
|
|
103
|
-
|
|
73
|
+
1. **Biggest risk found:** [one sentence]
|
|
74
|
+
2. **What I would tell the CEO:** [one sentence]
|
|
75
|
+
3. **What I did not test that still worries me:** [one sentence]
|
|
76
|
+
4. **Most useful heuristic / least useful:** [one line]
|
|
77
|
+
5. **Next session should focus on:** [one line]
|
|
104
78
|
|
|
105
|
-
|
|
79
|
+
## Session Stats
|
|
106
80
|
|
|
107
|
-
|
|
|
108
|
-
|
|
109
|
-
|
|
|
110
|
-
|
|
|
111
|
-
|
|
|
112
|
-
|
|
|
81
|
+
| Metric | Value |
|
|
82
|
+
|---|---|
|
|
83
|
+
| Duration | [N] min |
|
|
84
|
+
| Phases completed | [N]/8 |
|
|
85
|
+
| Bugs found | [N] (Critical: [N], High: [N], Medium: [N], Low: [N]) |
|
|
86
|
+
| Pages explored | [N] |
|
|
87
|
+
| Screenshots taken | [N] |
|
|
88
|
+
| Console errors found | [N] |
|
|
89
|
+
| Data integrity checks | [passed]/[total] |
|