qualiow-exploratory-testing 1.3.0 → 2.2.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (106) hide show
  1. package/.claude-plugin/marketplace.json +26 -0
  2. package/.claude-plugin/plugin.json +22 -0
  3. package/.env.example +27 -0
  4. package/CHANGELOG.md +259 -0
  5. package/README.md +472 -204
  6. package/agents/qa-diff-indexer-agent.md +81 -0
  7. package/agents/qa-gather-agent.md +41 -0
  8. package/agents/qa-page-mapper-agent.md +74 -0
  9. package/agents/qa-reporting-agent.md +103 -0
  10. package/{scripts → bin}/doctor-mobile.sh +57 -18
  11. package/bin/mcli +15 -9
  12. package/bin/mobile-cli.mjs +574 -286
  13. package/bin/qualiow +30 -0
  14. package/{scripts → bin}/setup-mobile.sh +56 -19
  15. package/bin/wadb +10 -4
  16. package/bin/wk-ios +29 -17
  17. package/bin/wkeval.mjs +7 -1
  18. package/data/domains/_default.yml +1 -1
  19. package/data/knowledge/changelog.yml +30 -12
  20. package/data/knowledge/manifest.yml +355 -127
  21. package/data/knowledge/releases/v0.1.0/entries/technique-business-logic-race-conditions.yml +1 -1
  22. package/data/knowledge/releases/v0.1.0/release.yml +8 -1
  23. package/data/knowledge/releases/v0.6.0/entries/technique-async-callback-contracts.yml +98 -0
  24. package/data/knowledge/releases/v0.6.0/entries/technique-exactly-once-verification.yml +116 -0
  25. package/data/knowledge/releases/v0.6.0/release.yml +30 -0
  26. package/data/security/SECURITY-POLICY.md +273 -0
  27. package/data/targets/_default.yml +1 -1
  28. package/data/targets/_example-api-only.yml +80 -0
  29. package/data/targets/_example-mobile-emulation.yml +2 -2
  30. package/data/targets/_example-native-mobile.yml +2 -2
  31. package/data/targets/_example-sim-android-chrome.yml +1 -1
  32. package/data/targets/_example-sim-ios-safari.yml +1 -1
  33. package/data/templates/api-probe-matrix.md +3 -3
  34. package/data/templates/bug-report.md +29 -151
  35. package/data/templates/coverage-map.md +9 -6
  36. package/data/templates/expected-behaviour.md +3 -2
  37. package/data/templates/session-charter.md +3 -0
  38. package/data/templates/session-report.md +57 -80
  39. package/dist/cli/index.js +2286 -701
  40. package/dist/index.d.ts +637 -81
  41. package/dist/index.js +2058 -228
  42. package/docs/BACKEND-VERIFICATION.md +39 -9
  43. package/docs/GETTING-STARTED.md +300 -121
  44. package/docs/MOBILE-SETUP.md +149 -18
  45. package/hooks/hooks.json +27 -0
  46. package/hooks/scripts/read-guard.mjs +95 -0
  47. package/hooks/scripts/secret-patterns.d.mts +8 -0
  48. package/hooks/scripts/secret-patterns.mjs +136 -0
  49. package/hooks/scripts/write-guard.mjs +87 -0
  50. package/package.json +33 -18
  51. package/skills/qa-explore/SKILL.md +32 -25
  52. package/skills/qa-explore/phases/00-setup.md +76 -42
  53. package/skills/qa-explore/phases/01-auth.md +32 -15
  54. package/skills/qa-explore/phases/02-charter.md +16 -5
  55. package/skills/qa-explore/phases/03-discovery.md +93 -27
  56. package/skills/qa-explore/phases/04-journeys.md +2 -2
  57. package/skills/qa-explore/phases/05-features.md +39 -24
  58. package/skills/qa-explore/phases/06-edge-cases.md +24 -13
  59. package/skills/qa-explore/phases/07-reporting.md +102 -142
  60. package/skills/qa-explore/references/context-integration.md +1 -1
  61. package/skills/qa-explore/references/delegation-rules.md +82 -0
  62. package/skills/qa-explore/references/output-contract.md +192 -0
  63. package/skills/qa-explore/references/paths.md +108 -0
  64. package/skills/qa-explore/references/playwright-agents-integration.md +61 -84
  65. package/skills/qa-explore/references/security-rules.md +70 -25
  66. package/skills/qa-explore/references/session-rules.md +2 -1
  67. package/skills/qa-explore/references/severity-guide.md +31 -4
  68. package/skills/qa-explore-cleanup/SKILL.md +51 -15
  69. package/skills/qa-explore-feedback/SKILL.md +23 -5
  70. package/skills/qa-explore-mobile/SKILL.md +86 -64
  71. package/skills/qa-explore-mobile/phases/00-setup.md +71 -62
  72. package/skills/qa-explore-mobile/phases/01-auth.md +28 -31
  73. package/skills/qa-explore-mobile/phases/02-charter.md +8 -4
  74. package/skills/qa-explore-mobile/phases/03-discovery.md +17 -11
  75. package/skills/qa-explore-mobile/phases/04-journeys.md +6 -6
  76. package/skills/qa-explore-mobile/phases/05-features.md +9 -9
  77. package/skills/qa-explore-mobile/phases/06-edge-cases.md +35 -40
  78. package/skills/qa-explore-mobile/phases/07-reporting.md +108 -60
  79. package/skills/qa-explore-mobile/references/mobile-edges.md +26 -26
  80. package/skills/qa-explore-quick/SKILL.md +71 -26
  81. package/skills/qa-explore-report/SKILL.md +65 -35
  82. package/skills/qa-gather/SKILL.md +44 -8
  83. package/skills/qa-knowledge-add/SKILL.md +25 -9
  84. package/skills/qa-knowledge-list/SKILL.md +37 -40
  85. package/skills/qa-target-setup/SKILL.md +63 -41
  86. package/skills/qa-verify-backend/SKILL.md +31 -19
  87. package/skills/qa-verify-backend/phases/00-setup.md +57 -12
  88. package/skills/qa-verify-backend/phases/01-ac-decomposition.md +2 -2
  89. package/skills/qa-verify-backend/phases/02-static-review.md +11 -0
  90. package/skills/qa-verify-backend/phases/03-live-verification.md +5 -3
  91. package/skills/qa-verify-backend/phases/03b-api-verification.md +24 -9
  92. package/skills/qa-verify-backend/phases/04-e2e-trigger.md +18 -2
  93. package/skills/qa-verify-backend/phases/05-reporting.md +72 -12
  94. package/skills/qa-verify-backend/references/api-probes.md +28 -1
  95. package/skills/qa-verify-backend/references/payload-verification.md +1 -1
  96. package/skills/qa-verify-backend/references/release-readiness.md +1 -1
  97. package/skills/qa-verify-backend/references/safety-rules.md +13 -8
  98. package/data/domains/_default.md +0 -181
  99. package/data/domains/ecommerce.md +0 -192
  100. package/data/domains/fintech.md +0 -200
  101. package/data/domains/identity.md +0 -88
  102. package/data/domains/marketing.md +0 -194
  103. package/data/domains/saas.md +0 -197
  104. package/dist/cli/index.d.ts +0 -1
  105. package/dist/cli/index.js.map +0 -1
  106. package/dist/index.js.map +0 -1
@@ -1,7 +1,7 @@
1
- # API Probe Matrix
1
+ > CONFIDENTIAL: This report may contain internal URLs, security vulnerabilities,
2
+ > and application details. Do not share outside your organization without review.
2
3
 
3
- > CONFIDENTIAL — internal QA artifact. Contains endpoint behaviour and environment
4
- > configuration. Keep local. Redact response bodies before saving.
4
+ # API Probe Matrix
5
5
 
6
6
  ## Session Reference
7
7
 
@@ -1,178 +1,56 @@
1
- # Bug Report
1
+ > CONFIDENTIAL: This report may contain internal URLs, security vulnerabilities,
2
+ > and application details. Do not share outside your organization without review.
2
3
 
3
- ## Title
4
+ # BUG-NNN: [Component] fails [Condition] causing [Impact]
4
5
 
5
- `[Component] fails [Condition] causing [Impact]`
6
+ > _Title example: `[Login Form] fails [when password contains special characters] causing [authentication error and user lockout]`. Number bugs from BUG-001 per session; one file per bug at `bugs/BUG-NNN.md`._
6
7
 
7
- > _Example: [Login Form] fails [when password contains special characters] causing [authentication error and user lockout]_
8
+ **Severity:** Critical | High | Medium | Low
9
+ **Priority:** P0 | P1 | P2 | P3
10
+ **Component:** [Component]
11
+ **URL:** [exact URL where the bug was found — mobile: screen name or deep link — backend: endpoint or resource]
12
+ **Environment:** [e.g. Playwright CLI, Chromium, 1280x720, logged in as X — mobile: mode / platform / device / OS — backend: env kind + build]
13
+ **Reproduction rate:** Always | Intermittent (~X%) | Once
8
14
 
9
- ---
15
+ > _Severity per `severity-guide.md`: Critical = data loss, security breach, financial loss, system unusable; High = major feature broken, no reasonable workaround; Medium = partial break, workaround exists, or an important missing feature; Low = cosmetic, rare edge case. **When in doubt, go one level LOWER.** Priority = severity adjusted by workaround and blast radius (P0 hours · P1 this sprint · P2 next sprint · P3 backlog)._
10
16
 
11
- ## Severity
17
+ ## Summary
12
18
 
13
- > Select one. See definitions below.
14
-
15
- - [ ] **Critical**
16
- - [ ] **High**
17
- - [ ] **Medium**
18
- - [ ] **Low**
19
-
20
- ### Severity Level Definitions
21
-
22
- | Level | Definition | Examples |
23
- |----------|----------------------------------------------------------------------------|-----------------------------------------------------------------------------------------------|
24
- | Critical | System down, data loss, security breach. Blocks all users immediately. | Payment gateway crashes on all transactions; user passwords exposed in API response; database corruption losing customer orders. |
25
- | High | Major feature broken, many users affected. No reasonable workaround. | Checkout fails for all credit card payments; search returns zero results for every query; login broken on mobile devices. |
26
- | Medium | Partial break, workaround exists. Some users affected under certain paths. | Discount code applies twice if user clicks fast; filter resets after pagination; profile photo upload fails on Safari only. |
27
- | Low | Cosmetic issue, rare edge case. Minimal user or business impact. | Footer alignment off by 2px on wide screens; tooltip text truncated in German locale; hover state missing on disabled button. |
28
-
29
- > **Note: When in doubt, go one level LOWER. Severity inflation destroys credibility.** A bug report rated "Critical" that turns out to be cosmetic undermines every future report you file. Reserve Critical for genuine emergencies. If you hesitate between two levels, pick the lower one and let the evidence speak for itself.
30
-
31
- ---
32
-
33
- ## URL
34
-
35
- `[URL where the bug was found]`
36
-
37
- ## Environment
38
-
39
- | Property | Value |
40
- |-----------|---------------------------|
41
- | Browser | [e.g., Chrome 125.0] |
42
- | Viewport | [e.g., 1920x1080] |
43
- | OS | [e.g., macOS 15.x] |
44
- | Auth | [e.g., logged in as X] |
45
- | Device | [e.g., Desktop / Mobile] |
46
-
47
- ---
19
+ [Two sentences: what breaks, and why it matters to the business.]
48
20
 
49
21
  ## Expected Behavior
50
22
 
51
- _What should happen according to requirements, conventions, or reasonable user expectations._
52
-
53
- > [Describe the expected outcome clearly.]
23
+ [What should happen according to requirements, conventions, or reasonable user expectations.]
54
24
 
55
25
  ## Actual Behavior
56
26
 
57
- _What actually happens instead._
58
-
59
- > [Describe the actual outcome. Be precise -- include error messages verbatim if applicable.]
60
-
61
- ---
27
+ [What actually happens instead. Be precise; include error messages verbatim.]
62
28
 
63
29
  ## Steps to Reproduce
64
30
 
65
31
  1. Navigate to `[URL]`
66
32
  2. [Action 2]
67
33
  3. [Action 3]
68
- 4. [Action 4]
69
- 5. Observe: [what goes wrong]
70
-
71
- > _Reproduction rate: [Always / Intermittent (~X%) / Once]_
72
-
73
- ---
34
+ 4. Observe: [what goes wrong]
74
35
 
75
36
  ## Business Impact
76
37
 
77
- > This section is **mandatory**. Every bug exists in a business context. Articulating impact helps engineering prioritize correctly and helps stakeholders understand the risk without needing to read technical details.
78
-
79
- ### Revenue Impact
80
-
81
- > [Does this bug prevent purchases, cause incorrect charges, block upgrades, or reduce conversion? Quantify if possible -- e.g., "Blocks all guest checkout, which represents ~30% of orders."]
82
-
83
- ### Trust Impact
84
-
85
- > [Would a user lose confidence in the product? Would they contact support, leave a negative review, or churn? e.g., "User sees a $0.00 balance briefly before correct amount loads -- creates panic."]
86
-
87
- ### Regulatory Risk
88
-
89
- > [Does this violate any compliance requirements? Specify the regulation. e.g., "Credit card number visible in URL query string -- PCI DSS violation." If none, write "No known regulatory risk."]
90
- >
91
- > Common frameworks to consider: SOX, PCI DSS, GDPR, CCPA, HIPAA, WCAG 2.1 AA, CAN-SPAM, KYC/AML, Regulation E.
92
-
93
- ### Data Risk
94
-
95
- > [Is data corrupted, lost, or exposed? e.g., "Order total saved as $0 in database when coupon equals cart value -- data integrity failure." If none, write "No data risk identified."]
96
-
97
- ### Scale
98
-
99
- > [How many users are affected and under what conditions? e.g., "All users on iOS Safari 17+ (~18% of mobile traffic)" or "Only affects accounts created before the migration on 2025-01-15 (~200 accounts)."]
100
-
101
- ---
38
+ > _Mandatory. Answer at least one bullet; write "none identified" for the rest. Quantify where you can ("blocks all guest checkout, ~30% of orders")._
102
39
 
103
- ## Risk Priority
104
-
105
- > Use this matrix to communicate urgency objectively.
106
-
107
- | Factor | Rating | Justification |
108
- |-------------|------------------|----------------------------------------------------|
109
- | Likelihood | High / Med / Low | [How likely is a user to hit this? Every time? Rare edge case?] |
110
- | Impact | High / Med / Low | [How bad is it when they do? Data loss? Mild annoyance?] |
111
- | **Risk** | **[Result]** | **Risk = Likelihood x Impact** (see matrix below) |
112
-
113
- ### Risk Matrix
114
-
115
- | | **Impact: Low** | **Impact: Med** | **Impact: High** |
116
- |--------------------|-----------------|-----------------|-------------------|
117
- | **Likelihood: High** | Medium | High | Critical |
118
- | **Likelihood: Med** | Low | Medium | High |
119
- | **Likelihood: Low** | Low | Low | Medium |
120
-
121
- ---
122
-
123
- ## Recommended Fix Priority
124
-
125
- > **Priority: [P0 / P1 / P2 / P3]**
126
-
127
- | Priority | Meaning | Typical SLA |
128
- |----------|--------------------------------------|----------------------|
129
- | P0 | Fix immediately, interrupt sprint | Hours |
130
- | P1 | Fix this sprint | Days |
131
- | P2 | Fix next sprint | 1-2 weeks |
132
- | P3 | Backlog, fix when convenient | When capacity allows |
133
-
134
- **Justification:** [Explain why this priority level is appropriate given the risk assessment and business impact above. e.g., "Risk is High (likely + revenue-impacting), but a workaround exists (users can switch payment method), so P1 rather than P0."]
135
-
136
- ---
137
-
138
- ## Impact
139
-
140
- ### User Impact
141
-
142
- > [How does this affect the end user? Can they complete their task? What is the degraded experience?]
143
-
144
- ### Business Impact Summary
145
-
146
- > [One-sentence summary referencing the detailed Business Impact section above. e.g., "Blocks ~30% of revenue through guest checkout with no workaround."]
147
-
148
- ---
40
+ - **Revenue impact:** [prevents purchases, incorrect charges, blocked upgrades, reduced conversion?]
41
+ - **Trust impact:** [would a user lose confidence, contact support, churn?]
42
+ - **Regulatory risk:** [SOX, PCI DSS, GDPR, CCPA, HIPAA, WCAG 2.1 AA, KYC/AML, Regulation E — name the regulation, or "none identified"]
43
+ - **Data risk:** [corrupted, lost, or exposed data?]
44
+ - **Scale:** [how many users, under what conditions]
149
45
 
150
46
  ## Evidence
151
47
 
152
- ### Screenshots
153
-
154
- > _Path: `output/sessions/[session-id]/screenshots/[filename].png`_
155
-
156
- ### Console Errors
157
-
158
- ```
159
- [Paste any relevant console errors here]
160
- ```
48
+ - Screenshot: `screenshots/BUG-NNN.png`
49
+ - Video: `videos/BUG-NNN.webm` (if recorded; `.mp4` on mobile)
50
+ - Log: `logs/BUG-NNN.log` (mobile) / `evidence/<file>` (backend), or "none"
51
+ - Console errors: [verbatim, redacted, or "none"]
52
+ - Network failures: [method, URL, status, response excerpt — redacted — or "none"]
161
53
 
162
- ### Network Failures
163
-
164
- ```
165
- [Paste any failed requests -- method, URL, status code, response body excerpt]
166
- ```
167
-
168
- ### Additional Logs
169
-
170
- ```
171
- [Any other diagnostic output -- application logs, state dumps, etc.]
172
- ```
173
-
174
- ---
175
-
176
- ## Additional Context
54
+ ## Recommended Fix Priority
177
55
 
178
- > [Any other relevant information: related bugs, recent deploys, feature flags, user reports, etc.]
56
+ [Why this priority relative to the other findings: risk (likelihood × impact, see `severity-guide.md`), workaround, blast radius, and anything related — recent deploys, feature flags, user reports.]
@@ -1,10 +1,13 @@
1
+ > CONFIDENTIAL: This report may contain internal URLs, security vulnerabilities,
2
+ > and application details. Do not share outside your organization without review.
3
+
1
4
  # Coverage Map
2
5
 
3
6
  ## Session Reference
4
7
 
5
8
  | Property | Value |
6
9
  |------------|--------------------------------|
7
- | Session ID | [e.g., SESSION-2026-03-28-001] |
10
+ | Session ID | [session directory, e.g. 2026-09-08-1420-explore-parabank] |
8
11
  | Target | [application or feature name] |
9
12
  | Date | [YYYY-MM-DD] |
10
13
 
@@ -12,11 +15,11 @@
12
15
 
13
16
  ## Overall Coverage
14
17
 
15
- | Area | Status | Heuristics Applied | Bugs Found | Notes |
16
- |------|--------|--------------------|------------|-------|
17
- | [Area 1] | tested / partial / not-tested | [list] | 0 | [notes] |
18
- | [Area 2] | tested / partial / not-tested | [list] | 0 | [notes] |
19
- | [Area 3] | tested / partial / not-tested | [list] | 0 | [notes] |
18
+ | Area | Risk | Status | Bugs | Notes |
19
+ |---|---|---|---|---|
20
+ | [Area 1] | P0 | tested | 0 | [heuristics applied, notes] |
21
+ | [Area 2] | P1 | partial | 0 | [what was not reached and why] |
22
+ | [Area 3] | P2 | not-tested | — | [reason] |
20
23
 
21
24
  ### Status Legend
22
25
 
@@ -1,6 +1,7 @@
1
- # Expected Behaviour Specification
1
+ > CONFIDENTIAL: This report may contain internal URLs, security vulnerabilities,
2
+ > and application details. Do not share outside your organization without review.
2
3
 
3
- > CONFIDENTIAL — internal QA artifact.
4
+ # Expected Behaviour Specification
4
5
 
5
6
  Use this when a verification session finds behaviour nobody wrote an acceptance criterion
6
7
  for — which is most of what an API probe turns up. A bug report says *this is wrong*. This
@@ -1,3 +1,6 @@
1
+ > CONFIDENTIAL: This report may contain internal URLs, security vulnerabilities,
2
+ > and application details. Do not share outside your organization without review.
3
+
1
4
  # Session Charter
2
5
 
3
6
  ```
@@ -1,112 +1,89 @@
1
- # Session Report
1
+ > CONFIDENTIAL: This report may contain internal URLs, security vulnerabilities,
2
+ > and application details. Do not share outside your organization without review.
2
3
 
3
- ## Session Metadata
4
-
5
- | Property | Value |
6
- |------------|--------------------------------|
7
- | Session ID | [e.g., SESSION-2026-03-28-001] |
8
- | Target | [application or feature name] |
9
- | URL | [target URL] |
10
- | Date | [YYYY-MM-DD] |
11
- | Duration | [e.g., 45 minutes] |
12
- | Tester | Claude AI |
13
- | Charter | [link to charter file] |
4
+ # Session Report — [target]
14
5
 
15
- ---
6
+ ## Session Metadata
16
7
 
17
- ## Charter Summary
8
+ | Field | Value |
9
+ |---|---|
10
+ | Session ID | [session directory, e.g. 2026-09-08-1420-explore-parabank] |
11
+ | Kind | explore / quick / mobile / backend |
12
+ | Target | [target id or application name] |
13
+ | URL | [base URL] |
14
+ | Date | [YYYY-MM-DD] |
15
+ | Duration | [N] min |
16
+ | Charter | charter.md |
18
17
 
19
- > [One-paragraph summary of the session charter: what was explored, with what tools/heuristics, and what we hoped to discover.]
18
+ ## Executive Summary
20
19
 
21
- ---
20
+ [Three sentences: what was tested, what was found, and the biggest risk.]
22
21
 
23
22
  ## Summary Stats
24
23
 
25
- | Metric | Count |
26
- |------------------------|-------|
27
- | Pages Explored | 0 |
28
- | Actions Performed | 0 |
29
- | Bugs Found -- Critical | 0 |
30
- | Bugs Found -- High | 0 |
31
- | Bugs Found -- Medium | 0 |
32
- | Bugs Found -- Low | 0 |
33
- | **Total Bugs** | **0** |
34
-
35
- ---
24
+ | Metric | Count |
25
+ |---|---|
26
+ | Pages explored | 0 |
27
+ | Actions performed | 0 |
28
+ | Bugs — Critical | 0 |
29
+ | Bugs — High | 0 |
30
+ | Bugs — Medium | 0 |
31
+ | Bugs — Low | 0 |
32
+ | **Total bugs** | **0** |
36
33
 
37
34
  ## Coverage Map
38
35
 
39
- _High-level view of what was tested. For full details see the dedicated coverage map file._
36
+ | Area | Risk | Status | Bugs | Notes |
37
+ |---|---|---|---|---|
38
+ | [Area 1] | P0 | tested | 0 | [notes] |
39
+ | [Area 2] | P1 | partial | 0 | [what was not reached and why] |
40
+ | [Area 3] | P2 | not-tested | — | [reason] |
40
41
 
41
- | Area | Status | Heuristics Applied | Bugs Found | Notes |
42
- |------|--------|--------------------|------------|-------|
43
- | [Area 1] | tested / partial / not-tested | [list] | 0 | [notes] |
44
- | [Area 2] | tested / partial / not-tested | [list] | 0 | [notes] |
45
- | [Area 3] | tested / partial / not-tested | [list] | 0 | [notes] |
46
-
47
- ---
42
+ _Status: `tested` (fully explored with the planned heuristics) · `partial` (visited, not all heuristics or paths exercised) · `not-tested` (in scope, not reached) · `code-verified-only` (believed correct from reading source, never observed running: this is UNVERIFIABLE, not a pass). Name the single not-tested item that carries the most risk._
48
43
 
49
44
  ## Bugs Found
50
45
 
51
- _Each bug links to its individual report in `output/bugs/`._
52
-
53
46
  | # | ID | Title | Severity | Report |
54
- |---|-----|-------|----------|--------|
55
- | 1 | [BUG-XXX] | [Component] fails [Condition] causing [Impact] | Critical/High/Medium/Low | [link] |
47
+ |---|---|---|---|---|
48
+ | 1 | BUG-001 | [Component] fails [Condition] causing [Impact] | Critical/High/Medium/Low | bugs/BUG-001.md |
56
49
 
57
- > _If no bugs were found, state: "No bugs were found during this session."_
58
-
59
- ---
50
+ _If no bugs were found, state: "No bugs were found during this session."_
60
51
 
61
52
  ## Observations
62
53
 
63
- _Things noticed during testing that are not bugs but may be worth discussing._
64
-
65
- - [Observation 1 -- e.g., page load time felt slow on dashboard but did not exceed threshold]
66
- - [Observation 2 -- e.g., tooltip text seems inconsistent with other similar features]
67
- - [Observation 3]
54
+ _Things noticed that are not bugs but may be worth discussing: what's MISSING against the domain checklist, data-integrity results, questions for the team._
68
55
 
69
- ---
70
-
71
- ## Questions
72
-
73
- _Unclear behaviors that need human review to determine if they are bugs or intended._
74
-
75
- - [ ] [Question 1 -- e.g., Is the empty state message on /reports intentional when no data exists?]
76
- - [ ] [Question 2 -- e.g., Should the "Save" button remain enabled when no changes have been made?]
77
- - [ ] [Question 3]
78
-
79
- ---
56
+ - [Observation 1]
57
+ - [ ] [Question 1 — unclear behaviour that needs a human to decide whether it is a bug]
80
58
 
81
59
  ## Areas Not Tested
82
60
 
83
- _Parts of the charter or scope that were not covered, with reasons._
84
-
85
61
  | Area | Reason |
86
- |------|--------|
87
- | [Area 1] | [e.g., Blocked by authentication issue] |
88
- | [Area 2] | [e.g., Time box expired before reaching this area] |
89
- | [Area 3] | [e.g., Feature not yet deployed to test environment] |
90
-
91
- ---
62
+ |---|---|
63
+ | [Area 1] | [e.g. blocked by authentication issue] |
64
+ | [Area 2] | [e.g. time box expired before reaching this area] |
92
65
 
93
66
  ## Recommendations
94
67
 
95
- _What should be tested next, based on findings from this session._
96
-
97
- - [ ] [Recommendation 1 -- e.g., Deep-dive into payment flow edge cases]
98
- - [ ] [Recommendation 2 -- e.g., Regression test the login form after fix for BUG-001]
99
- - [ ] [Recommendation 3 -- e.g., Cross-browser testing on Safari for the dashboard]
68
+ - [ ] [Recommendation 1 — e.g. deep-dive into payment-flow edge cases]
69
+ - [ ] [Recommendation 2 — e.g. regression-test the login form after the fix for BUG-001]
100
70
 
101
- ---
71
+ ## Reflection
102
72
 
103
- ## Session Quality Metrics
73
+ 1. **Biggest risk found:** [one sentence]
74
+ 2. **What I would tell the CEO:** [one sentence]
75
+ 3. **What I did not test that still worries me:** [one sentence]
76
+ 4. **Most useful heuristic / least useful:** [one line]
77
+ 5. **Next session should focus on:** [one line]
104
78
 
105
- _How time was spent during this session._
79
+ ## Session Stats
106
80
 
107
- | Activity | % of Time | Notes |
108
- |---------------------|-----------|--------------------------------|
109
- | Exploration | 0% | [Navigating and testing] |
110
- | Bug Investigation | 0% | [Reproducing and documenting] |
111
- | Setup | 0% | [Environment, auth, tooling] |
112
- | **Total** | **100%** | |
81
+ | Metric | Value |
82
+ |---|---|
83
+ | Duration | [N] min |
84
+ | Phases completed | [N]/8 |
85
+ | Bugs found | [N] (Critical: [N], High: [N], Medium: [N], Low: [N]) |
86
+ | Pages explored | [N] |
87
+ | Screenshots taken | [N] |
88
+ | Console errors found | [N] |
89
+ | Data integrity checks | [passed]/[total] |