@captain_z/zsk-skills 1.8.10 → 1.8.11

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@captain_z/zsk-skills",
3
- "version": "1.8.10",
3
+ "version": "1.8.11",
4
4
  "description": "ZNorth Standard Kit — core harness-first skill content package",
5
5
  "license": "MIT",
6
6
  "files": [
@@ -63,11 +63,16 @@ Use this stage when tasks are approved for implementation. Coding owns small beh
63
63
  - refactor only while GREEN, then rerun the affected focused test.
64
64
  7. Add or update tests at the same risk level as the change; do not write all
65
65
  tests first and then all implementation.
66
- 8. For issue-driven `fix` work, update the issue with changed files, root cause, evidence commands, documentation feedback target or no-update rationale, and next verification route.
67
- 9. Run or cite fresh lint/typecheck/static diagnostics for the touched stack and confirm zero ESLint or TypeScript error/warning-level Problems before ready-for-smoke.
68
- 10. Produce a validation packet for meaningful behavior changes. Map every acceptance criterion to evidence, classify each evidence item as unit, integration, smoke, manual, static, or review, record mock boundaries, and mark contract tiers as intrinsic engineering, contextual spec/design/task, or workflow governance.
69
- 11. When an anchor packet is available, compare current implementation facts against intent, scope, acceptance criteria, design decisions, validation expectations, resource versions, and assumptions. Report local drift signals with class, severity, recommended workflow action, and confidence impact.
70
- 12. Record commands, evidence, blockers, changed files, per-behavior TDD cycles, validation packet status, drift signals, and any dynamic best-practice sources for `smoke`/`review`.
66
+ 8. When changed behavior maps to a scenario catalog or task scenario strategy,
67
+ create or update the smallest source-aligned test, integration check, API
68
+ check, or draft scenario needed by that layer. Do not promote browser drafts
69
+ or claim UI regression coverage without demo observation and locator
70
+ refinement.
71
+ 9. For issue-driven `fix` work, update the issue with changed files, root cause, evidence commands, documentation feedback target or no-update rationale, and next verification route.
72
+ 10. Run or cite fresh lint/typecheck/static diagnostics for the touched stack and confirm zero ESLint or TypeScript error/warning-level Problems before ready-for-smoke.
73
+ 11. Produce a validation packet for meaningful behavior changes. Map every acceptance criterion to evidence, classify each evidence item as unit, integration, smoke, manual, static, or review, record mock boundaries, and mark contract tiers as intrinsic engineering, contextual spec/design/task, or workflow governance.
74
+ 12. When an anchor packet is available, compare current implementation facts against intent, scope, acceptance criteria, design decisions, validation expectations, resource versions, and assumptions. Report local drift signals with class, severity, recommended workflow action, and confidence impact.
75
+ 13. Record commands, evidence, blockers, changed files, per-behavior TDD cycles, validation packet status, drift signals, and any dynamic best-practice sources for `smoke`/`review`.
71
76
 
72
77
  ## Constraints
73
78
 
@@ -78,6 +83,8 @@ Use this stage when tasks are approved for implementation. Coding owns small beh
78
83
  not replace per-behavior RED/GREEN evidence with one final large test result
79
84
  set.
80
85
  - No treating green unit tests as completion by themselves. If critical wiring is mocked, include integration, smoke, manual, or review evidence, or explicitly report the validation gap.
86
+ - No treating generated browser draft specs as regression evidence until demo
87
+ preflight supplies observation handoff and the draft is refined/promoted.
81
88
  - No hiding placeholder code, hacks, broad refactors, style/type diagnostics, error-handling gaps, scope violations, or contract violations behind passing tests.
82
89
  - No mutating workflow state from local drift findings. Report drift, blocker,
83
90
  and issue-update payloads; the workflow or human decides sequencing and
package/zsk-demo/SKILL.md CHANGED
@@ -58,16 +58,22 @@ negativeExamples:
58
58
 
59
59
  # Demo
60
60
 
61
- Development demo before formal testing. Build a module-grouped, audience-ready demo outline, generate Playwright cases from formal raw testing inputs through `test-plan.json`, run rehearsed Playwright demonstration steps, record demo-only issues, preserve evidence, and leave reusable Playwright scenarios when possible.
61
+ Development demo before formal testing. Build a module-grouped, audience-ready
62
+ demo outline, generate a scenario catalog and test strategy from source inputs,
63
+ run browser preflight to capture low-token UI observation handoffs, rehearse
64
+ visible flows, record demo-only issues, preserve evidence, and promote reusable
65
+ Playwright scenarios only after locator refinement.
62
66
 
63
67
  Default `/demo` execution follows the optimized SOP:
64
68
 
65
69
  ```text
66
- tests.raw_cases / sources.testing, normally .zsk/raws/testing
70
+ tests.raw_cases / sources.testing / spec / issue / manual notes / existing tests
71
+ -> scenario-catalog.json with sourceRefs, steps, expected results, and gaps
72
+ -> test-plan.json with automationStrategy by verification layer
67
73
  -> UI observation handoff for current-page state and locator hints
68
- -> zsk/agent-written test-plan.json in tests.derived_cases
69
- -> Playwright generator/CLI/Skills-written .spec.ts in tests.automated.e2e
70
- -> Playwright Test/UI/debug execution and evidence under `.zsk/modules/{module}/_playwright` and `.zsk/modules/{module}/_evidence`
74
+ -> Playwright draft specs under `_playwright/drafts/*.pw-draft.ts`
75
+ -> refined promoted specs under `_playwright/specs/*.spec.ts`
76
+ -> Playwright Test/UI/debug execution and demo evidence
71
77
  ```
72
78
 
73
79
  Use Playwright `storageState`, persistent context, CDP, or fixture login to reuse credentials before relying on live UI tools. For authenticated products, demo must solve login first: perform first-time login once, save module-local storageState under `.zsk/modules/{module}/_playwright/.auth/`, and make all generated specs fail fast with a clear auth bootstrap instruction instead of letting every business scenario fail on the login page. The project may declare `automation.demo.auth.envFiles` such as `~/.zshrc` and `automation.demo.auth.env` key names such as `username: DEMO_USERNAME`; never write credential values into `.zsk/config.yaml` or generated artifacts. Computer Use is the preferred current-page or visual observation lane when it is available and authorized. If Computer Use is unavailable, such as in runtimes that do not expose it, fall back to Playwright MCP/ARIA/CDP snapshots, deterministic Playwright inspection, documented manual evidence, or Browser Use only where the runtime explicitly supports it and permissions are available. Any UI observation tool is observation-only in this path: it may describe URL, page title, visible targets, role/label hints, auth/session notes, and privacy concerns, but it must not write repo artifacts, `test-plan.json`, or final `.spec.ts` files. Optimized `/demo` must not silently fall back to Playwright MCP or the legacy hybrid bridge.
@@ -101,7 +107,11 @@ Every demo step must have complete source alignment:
101
107
 
102
108
  Do not include orphan demo steps that cannot be traced to those sources. Do not omit required function points from the PRD/SRS unless the omission is called out as a known gap with owner and reason.
103
109
 
104
- If a formal test case and UI observation handoff are available, demo should generate or refresh a Playwright case before running it. Prefer `raw test case + Computer Use or Playwright observation + test-plan.json + Playwright locator generation` over screenshot-only generation. Use the legacy hybrid lane explicitly when MCP or non-default UI observation is required.
110
+ If a formal test case and UI observation handoff are available, demo should
111
+ generate or refresh a draft Playwright case before running it. Prefer
112
+ `scenario catalog + UI observation handoff + test-plan.json + Playwright draft`
113
+ over screenshot-only generation. Use the legacy hybrid lane explicitly when MCP
114
+ or non-default UI observation is required.
105
115
 
106
116
  ## Operating Constraints
107
117
 
@@ -130,7 +140,7 @@ demo run computer-use -> zsk demo run --computer-use
130
140
  demo run hybrid -> zsk demo run --hybrid
131
141
  demo auth -> zsk demo auth -m <module> --url <login-or-app-url>
132
142
  demo capture -> zsk demo capture
133
- demo scenario generate -> zsk demo scenario generate --test-case <path> --snapshot <path>
143
+ demo scenario generate -> zsk demo scenario generate --case-id <id> --observation <path>
134
144
  demo complete -> zsk demo complete
135
145
  ```
136
146
 
@@ -150,7 +160,13 @@ Computer Use, Browser Use, or manual evidence outside optimized mode must record
150
160
  The optimized lane exchanges structured artifacts:
151
161
 
152
162
  - `test-plan.json`: source-aligned test intent, preconditions, UI observation summary, locator hints, steps, assertions, auth handoff, risks, and generated spec target.
153
- - `.spec.ts`: final executable Playwright test generated from `test-plan.json`, following Playwright locator and assertion best practices.
163
+ - `scenario-catalog.json`: normalized scenarios from QA tables, markdown,
164
+ spec, issue notes, manual notes, and existing tests.
165
+ - `uiObservationHandoff`: tool-neutral observation payload from Agent Browser,
166
+ Browser Use, Computer Use, Playwright ARIA/CDP, or manual evidence.
167
+ - `.pw-draft.ts`: draft Playwright test with source alignment and locator hints.
168
+ - `.spec.ts`: promoted executable Playwright test after observation evidence and
169
+ locator refinement.
154
170
 
155
171
  The legacy hybrid lane exchanges structured artifacts:
156
172
 
@@ -165,9 +181,13 @@ Demo has two sub-phases:
165
181
  - Create a flow-first demo outline from PRD/SRS, spec/design, task, and test evidence before writing or running cases.
166
182
  - Order function points by user/business journey, not by file order or resource order.
167
183
  - Add a coverage alignment table that proves each demo step maps to the original requirement, design/spec contract, task scope, and expected test result.
168
- - Computer Use captures current page, human goal, visible controls, and candidate locators when Playwright cannot infer intent by itself; if unavailable, use Playwright MCP/ARIA/CDP, documented manual evidence, or compatible Browser Use.
184
+ - Agent Browser, Browser Use, Computer Use, Playwright ARIA/CDP, or manual
185
+ evidence captures current page, human goal, visible controls, and candidate
186
+ locators when deterministic scripts cannot infer intent by themselves.
169
187
  - The agent combines UI observation state with SRS/spec/design rows, formal QA cases, automation/e2e cases, and unit-test assertions/fixtures that define expected behavior.
170
- - Playwright pre-write cases are drafted under `.zsk/modules/{module}/_playwright/specs/` with explicit auth bootstrap, module-local storageState reuse, and candidate locator fallbacks.
188
+ - Playwright pre-write cases are drafted under `.zsk/modules/{module}/_playwright/drafts/` with explicit auth bootstrap, module-local storageState reuse, and candidate locator fallbacks.
189
+ - Promotion to `.zsk/modules/{module}/_playwright/specs/` requires a
190
+ `uiObservationHandoff`, refined locators, and `zsk check` compatibility.
171
191
  - Playwright dry-runs or UI-runs the cases, recording trace/report/screenshots and pausing on selector/auth drift.
172
192
  2. Demo Show:
173
193
  - Use only the pre-written, already dry-run Playwright cases for external demonstration.
@@ -179,8 +199,11 @@ The handoff loop is:
179
199
  1. Identify: Computer Use identifies the human goal, current page state, likely control to click/type, and candidate locators when Playwright cannot know which visible element matches the user's intent. If unavailable, use Playwright MCP/ARIA/CDP, manual evidence, or compatible Browser Use.
180
200
  2. Persist state: zsk or the agent generator persists UI observations into `test-plan.json` or a separate handoff note before spec generation, including URL, candidate locator text, storage/session hint, profile source, visible login state, and privacy note. The observation tool itself is not the repo writer.
181
201
  3. Pre-write: zsk or the agent generator converts source evidence plus UI observations into `test-plan.json` and then Playwright specs, preferring role-based locators and including any auth handoff that Playwright can reproduce.
182
- 4. Rehearse: Playwright runs the pre-written cases with `storageState`, persistent context, CDP, or fixture login when available, then records trace/UI/report evidence.
183
- 5. Perform: Demo Show uses the rehearsed Playwright cases; successful runs are promoted to reusable verify/regression scenarios.
202
+ 4. Rehearse: Playwright runs the draft or promoted cases with `storageState`,
203
+ persistent context, CDP, or fixture login when available, then records
204
+ trace/UI/report evidence.
205
+ 5. Perform: Demo Show uses rehearsed cases; only refined drafts with observation
206
+ evidence are promoted to reusable verify/regression scenarios.
184
207
 
185
208
  Repeat the loop until the demo function point is passed, paused, or converted into a Demo Issue.
186
209
 
@@ -190,10 +213,18 @@ The agent should synthesize Playwright cases before the external demo from raw t
190
213
 
191
214
  1. Load SRS/spec/design rows, formal QA cases, existing automation/e2e cases, and relevant unit-test assertions/fixtures.
192
215
  2. Read Computer Use observation when current-page visual state or human-intent locator mapping is needed and available; otherwise use Playwright MCP/ARIA/CDP, documented manual evidence, or compatible Browser Use. Map auth to Playwright `storageState`, persistent context, CDP, or documented manual setup.
193
- 3. Generate `test-plan.json` under `tests.derived_cases` with source links, step intent, locator hints, assertions, auth handoff, risks, and generated spec target.
194
- 4. Generate a Playwright spec under `tests.automated.e2e` using role-first locators, explicit auth bootstrap, persisted storageState reuse, and assertions derived from source evidence.
195
- 5. Rehearse it with Playwright UI/trace/report evidence and preserve trace/screenshots/video under `.zsk/modules/{module}/_playwright` or `.zsk/modules/{module}/_evidence`.
196
- 6. Use the rehearsed case for Demo Show; do not improvise new clicks during the external demo unless the prepared case is blocked and the blocker is recorded.
216
+ 3. Generate `scenario-catalog.json` and `test-plan.json` under
217
+ `_playwright/test-plans/` with source links, automation strategy, step intent,
218
+ locator hints, assertions, auth handoff, risks, and draft/promoted targets.
219
+ 4. Generate a draft Playwright spec under `_playwright/drafts/` using role-first
220
+ locators, explicit auth bootstrap, persisted storageState reuse, and
221
+ assertions derived from source evidence.
222
+ 5. Rehearse it with Playwright UI/trace/report evidence and preserve
223
+ trace/screenshots/video under `.zsk/modules/{module}/_playwright` or
224
+ `.zsk/modules/{module}/_evidence`.
225
+ 6. Promote only after observation evidence and locator refinement; use the
226
+ rehearsed case for Demo Show and do not improvise new clicks during the
227
+ external demo unless the prepared case is blocked and recorded.
197
228
 
198
229
  Playwright MCP and Browser Use are compatibility lanes, not assumptions. Computer Use is preferred for visual/current-page observation when available; all observation lanes remain observation-only in optimized mode.
199
230
 
@@ -204,6 +235,11 @@ zsk demo scenario generate \
204
235
  -m checkout \
205
236
  --test-case .zsk/raws/testing/checkout-happy-path.md \
206
237
  --name "Checkout happy path"
238
+
239
+ zsk demo scenario generate \
240
+ -m checkout \
241
+ --case-id checkout-001 \
242
+ --observation .zsk/modules/checkout/_playwright/observations/checkout.agent-browser.json
207
243
  ```
208
244
 
209
245
  ## Session Lifecycle
@@ -270,15 +306,20 @@ Direct mode starts from the user's explicit target. Workflow-only artifacts, app
270
306
  - tasks
271
307
  - deployment
272
308
  - test-cases
309
+ - scenario-catalog
273
310
  - ui-observation-handoff
274
- - playwright-cases
311
+ - draft-playwright-specs
275
312
 
276
313
  **Required outputs**
277
314
 
278
315
  - demo-outline
279
316
  - demo-report
280
317
  - demo-issues
281
- - demo-scenarios
318
+ - scenario-catalog
319
+ - test-plan
320
+ - ui-observation-handoff
321
+ - draft-playwright-specs
322
+ - promoted-playwright-specs
282
323
  - playwright-execution
283
324
 
284
325
  ### Quality Rubric
@@ -24,15 +24,20 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
24
24
  - `tasks`
25
25
  - `deployment`
26
26
  - `test-cases`
27
+ - `scenario-catalog`
27
28
  - `ui-observation-handoff`
28
- - `playwright-cases`
29
+ - `draft-playwright-specs`
29
30
 
30
31
  ## Required Outputs
31
32
 
32
33
  - `demo-outline`
33
34
  - `demo-report`
34
35
  - `demo-issues`
35
- - `demo-scenarios`
36
+ - `scenario-catalog`
37
+ - `test-plan`
38
+ - `ui-observation-handoff`
39
+ - `draft-playwright-specs`
40
+ - `promoted-playwright-specs`
36
41
  - `playwright-execution`
37
42
 
38
43
  ## Required Output Enforcement
@@ -43,8 +48,8 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
43
48
 
44
49
  ## Allowed Tools And Capabilities
45
50
 
46
- - Tools: `playwright-cli`, `playwright-test`, `computer-use`, `playwright-mcp`, `browser-use`, `issue-create`
47
- - Capabilities: `flow-first-demo`, `scenario-generation`, `visible-rehearsal`
51
+ - Tools: `playwright-cli`, `playwright-test`, `computer-use`, `playwright-mcp`, `browser-use`, `agent-browser`, `issue-create`
52
+ - Capabilities: `flow-first-demo`, `scenario-catalog-extraction`, `browser-preflight`, `scenario-generation`, `visible-rehearsal`, `scenario-promotion`
48
53
  - Script policy: `recommended`
49
54
  - Browser Use policy: `conditional`
50
55
 
@@ -103,8 +108,8 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
103
108
 
104
109
  - `output_goal`: Rehearse user-visible flows from source-backed scenarios and capture demo evidence.
105
110
  - `downstream_consumer`: Next legal ZSK stage or reviewer.
106
- - `required_inputs`: spec, design, tasks, deployment, test-cases, ui-observation-handoff, playwright-cases
107
- - `required_outputs`: demo-outline, demo-report, demo-issues, demo-scenarios, playwright-execution
111
+ - `required_inputs`: spec, design, tasks, deployment, test-cases, scenario-catalog, ui-observation-handoff, draft-playwright-specs
112
+ - `required_outputs`: demo-outline, demo-report, demo-issues, scenario-catalog, test-plan, ui-observation-handoff, draft-playwright-specs, promoted-playwright-specs, playwright-execution
108
113
  - `must_answer_questions`: Which scenario, account/state, route, and expected observable result were exercised? / What was visible to the user, and what evidence was captured? / Which demo gaps become defects or task/spec/design feedback?
109
114
  - `quality_checks`: Consumes spec scenarios and task case skeletons instead of inventing flows during demo. / Records storageState path, first-login/bootstrap path, and explicit public-flow waiver when auth is not required. / Records screenshots/traces/logs where they materially prove visible behavior.
110
115
  - `anti_patterns`: Manual click-through notes with no scenario linkage. / Treating login/setup failure as an app defect without classification.
@@ -201,13 +201,18 @@ skills:
201
201
  - tasks
202
202
  - deployment
203
203
  - test-cases
204
+ - scenario-catalog
204
205
  - ui-observation-handoff
205
- - playwright-cases
206
+ - draft-playwright-specs
206
207
  outputs:
207
208
  - demo-outline
208
209
  - demo-report
209
210
  - demo-issues
210
- - demo-scenarios
211
+ - scenario-catalog
212
+ - test-plan
213
+ - ui-observation-handoff
214
+ - draft-playwright-specs
215
+ - promoted-playwright-specs
211
216
  - playwright-execution
212
217
  tools:
213
218
  - playwright-cli
@@ -215,10 +220,14 @@ skills:
215
220
  - computer-use
216
221
  - playwright-mcp
217
222
  - browser-use
223
+ - agent-browser
218
224
  - issue-create
219
225
  capabilities:
220
226
  - flow-first-demo
227
+ - scenario-catalog-extraction
228
+ - browser-preflight
221
229
  - scenario-generation
222
230
  - visible-rehearsal
231
+ - scenario-promotion
223
232
  script: recommended
224
233
  browserUse: conditional
@@ -49,6 +49,9 @@ implementation, review, release, or acceptance work.
49
49
 
50
50
  Smoke is the developer-owned proof that changed behavior works well enough to be
51
51
  inspected further when a workflow or human chooses to do so.
52
+ Smoke runs targeted checks for changed behavior. It does not require a full E2E
53
+ suite unless the changed behavior itself can only be credibly smoke-proved
54
+ through a focused browser/API/integration path.
52
55
 
53
56
  ## Inputs
54
57
 
@@ -61,11 +64,15 @@ inspected further when a workflow or human chooses to do so.
61
64
  ## Procedure
62
65
 
63
66
  1. Confirm each targeted test or scenario maps to the intended requirement, function point, and expected behavior.
64
- 2. Run targeted tests for changed behavior first.
65
- 3. Run lint/typecheck/build/smoke checks when relevant to the touched surface.
66
- 4. Capture exact commands, environment, results, source alignment, and evidence links.
67
- 5. Convert failures into coding fixes or smoke issues with repro command, actual/expected behavior, severity, root-cause hypothesis, and regression guard.
68
- 6. For `fix` routes, record whether the smoke command exercises the original issue reproduction, the regression guard, or both.
67
+ 2. Use the scenario catalog or task strategy when present to select the narrowest
68
+ credible layer: unit, integration, api-e2e, browser-e2e, visual-observation,
69
+ or manual-blocker.
70
+ 3. Run targeted tests for changed behavior first.
71
+ 4. Run lint/typecheck/build/smoke checks when relevant to the touched surface.
72
+ 5. Capture exact commands, environment, results, source alignment, and evidence links.
73
+ 6. Classify passed, failed, skipped, flaky, unrun, and N/A checks explicitly.
74
+ 7. Convert failures into coding fixes or smoke issues with repro command, actual/expected behavior, severity, root-cause hypothesis, and regression guard.
75
+ 8. For `fix` routes, record whether the smoke command exercises the original issue reproduction, the regression guard, or both.
69
76
 
70
77
  ## Constraints
71
78
 
package/zsk-spec/SKILL.md CHANGED
@@ -101,18 +101,23 @@ Conditional hard requirements: when the behavior touches auth, permissions, role
101
101
 
102
102
  Advisory guidance: keep IDs stable, keep implementation choices out unless they are product contract, and write `未指定` for unsupplied thresholds.
103
103
 
104
- ## Playwright Scenario Contract
104
+ ## Observable Scenario Contract
105
105
 
106
- For UI-visible behavior, spec should define scenario contracts before implementation:
106
+ For important behavior, spec should define observable scenario contracts before
107
+ implementation. These contracts are the source for a later scenario catalog;
108
+ they are not executable selector plans.
107
109
 
108
110
  - user-visible goal
109
111
  - route/page entry
110
112
  - role/account/data preconditions
111
113
  - observable success/failure states
112
114
  - AC/FR linkage
113
- - whether the scenario must become a Playwright case
115
+ - preferred verification layer when known: browser-e2e, api-e2e, integration,
116
+ unit, visual-observation, or manual-blocker
117
+ - whether the scenario is a smoke/demo/verify/regression candidate
114
118
 
115
- Do not write brittle selectors in spec. Save locator strategy for design.
119
+ Do not write brittle selectors in spec. Save locator strategy, runtime evidence,
120
+ and browser observation details for design/task/demo.
116
121
 
117
122
  ## Outputs
118
123
 
package/zsk-task/SKILL.md CHANGED
@@ -144,15 +144,20 @@ hierarchy syncs as `parent-child` links. Multica, Jira, GitHub Issues, GitLab,
144
144
  Linear, or future providers remain adapter outputs of `zsk work sync --dry-run`.
145
145
  Task does not assign or start agents.
146
146
 
147
- ## Playwright Task Output
147
+ ## Scenario Strategy Output
148
148
 
149
- Task planning should create or update Playwright case skeletons before demo:
149
+ Task planning should map important scenarios to verification layers and evidence
150
+ hooks before demo:
150
151
 
151
- - map each P0/P1 scenario contract to a case file
152
+ - map each P0/P1 scenario contract to browser-e2e, api-e2e, integration, unit,
153
+ visual-observation, or manual-blocker
152
154
  - define fixture/auth/bootstrap needs
153
- - mark which cases are smoke/demo, verify, or regression
155
+ - mark which scenarios are smoke/demo, verify, or regression candidates
156
+ - point demo candidates at `.zsk/modules/{module}/_playwright/drafts/` for
157
+ draft Playwright generation, not promoted specs
154
158
  - include implementation tasks for missing labels/test ids needed by stable locators
155
- - ensure demo consumes existing case skeletons instead of inventing flows during the meeting
159
+ - ensure demo consumes scenario contracts, test-plan strategy, and observation
160
+ handoffs instead of inventing flows during the meeting
156
161
 
157
162
  ## Scenario Synthesis
158
163
 
@@ -163,7 +168,9 @@ When structured page information is available from Playwright MCP, Accessibility
163
168
  - design locator/state strategy
164
169
  - structured page information
165
170
 
166
- The result should be a reviewable Playwright spec skeleton, not an unreviewed final test. Demo executes and calibrates it later.
171
+ The result should be a reviewable draft Playwright spec or scenario plan, not an
172
+ unreviewed promoted test. Demo executes, observes, rehearses, and calibrates it
173
+ later; promotion requires refined locators and observation evidence.
167
174
 
168
175
  ## Outputs
169
176
 
@@ -175,7 +182,7 @@ The result should be a reviewable Playwright spec skeleton, not an unreviewed fi
175
182
  qa-case-pack claims, mapped tasks, evidence route, and blocker/N/A rationale.
176
183
  - Control-row task coverage matrix when triggered.
177
184
  - FR/AC coverage matrix.
178
- - Playwright case skeletons or documented non-UI reason.
185
+ - Scenario strategy matrix and draft Playwright targets or documented non-UI reason.
179
186
  - Work-event preview for every provider-syncable task group and subtask,
180
187
  including expected `work.item.upserted` and `work.item.linked` records, or a
181
188
  `work-task-emit` evidence plan explaining blocked or unchanged task items.
@@ -45,6 +45,8 @@ workflow route.
45
45
  - Ready-for-verify handoff.
46
46
  - Linked issues, reproduction steps, expected outcomes, and evidence.
47
47
  - Deployment/version information and reusable scenarios.
48
+ - Scenario catalog, promoted Playwright specs, API/integration evidence, demo
49
+ evidence, defect packs, and ready handoff when present.
48
50
  - `qa-case-pack`, `defect-pack`, and issue-source records when reviewed
49
51
  readiness packs exist.
50
52
  - For issue-driven `fix` routes: issue path/id, root-cause note, changed files, regression guard, and smoke/review evidence.
@@ -52,25 +54,31 @@ workflow route.
52
54
  ## Procedure
53
55
 
54
56
  1. Restate the claim being verified and the smallest proof needed.
55
- 2. Re-run reproduction or acceptance checks independently.
56
- 3. When `qa-case-pack` or `defect-pack` exists, compare actual behavior to its
57
+ 2. Load applicable replay sources: scenario catalog, promoted browser specs,
58
+ API/integration evidence, qa-case-pack, defect-pack, demo report, and ready
59
+ handoff. Record which were consumed or why none applied.
60
+ 3. Re-run reproduction or acceptance checks independently.
61
+ 4. When `qa-case-pack` or `defect-pack` exists, compare actual behavior to its
57
62
  reviewed expected/actual/test-basis facts and sourceRefs before considering
58
63
  provider status, tracker labels, or implementation claims.
59
- 4. Compare actual behavior to spec/issue expectations.
60
- 5. Record pass/fail evidence with commands, screenshots, traces, or manual notes.
61
- 6. Classify failures by likely owner and recommended action based on root cause.
62
- 7. When verification fails, return an issue-update payload with repro,
64
+ 5. Compare actual behavior to spec/issue expectations.
65
+ 6. Record pass/fail evidence with commands, screenshots, traces, or manual notes.
66
+ 7. Classify failures by likely owner and recommended action based on root cause.
67
+ 8. When verification fails, return an issue-update payload with repro,
63
68
  actual/expected, severity, root cause, and documentation feedback target.
64
- 8. When verification passes, return a verified issue-update payload with
69
+ 9. When verification passes, return a verified issue-update payload with
65
70
  evidence, while leaving spec/design feedback pending until the user/product
66
71
  owner confirms the fix is acceptable.
67
- 9. For `fix` routes, confirm that the issue record contains a documentation feedback target or no-update rationale before recommending closure.
72
+ 10. For `fix` routes, confirm that the issue record contains a documentation feedback target or no-update rationale before recommending closure.
68
73
 
69
74
  ## Constraints
70
75
 
71
76
  - Do not accept developer evidence without independent checking when independence is required.
72
77
  - Do not verify against an unversioned or unknown environment.
73
78
  - Do not broaden the scope beyond linked claims.
79
+ - Do not invent new test scope, new scenarios, or locator strategy during
80
+ verify. If coverage is missing, record a blocker/gap and route it back to
81
+ task/demo/coding.
74
82
  - Do not mark pass with missing evidence.
75
83
  - Do not verify from provider status alone when reviewed qa-case-pack or
76
84
  defect-pack facts are available.
@@ -83,6 +91,8 @@ workflow route.
83
91
  - Pass/fail decision per issue/AC.
84
92
  - QA/defect pack consumption result when applicable: sourceRefs checked,
85
93
  expected/actual basis, assumptions, blockers, and replay evidence.
94
+ - Scenario catalog / promoted spec / demo evidence consumption result when
95
+ applicable, or a recorded reason none applied.
86
96
  - Acceptance readiness or failure classification.
87
97
  - Issue-update payload and documentation feedback target.
88
98
 
@@ -153,6 +163,9 @@ Direct mode starts from the user's explicit target. Workflow-only artifacts, app
153
163
  - ready-handoff
154
164
  - fixed-issues
155
165
  - test-cases
166
+ - scenario-catalog
167
+ - promoted-playwright-specs
168
+ - api-integration-evidence
156
169
  - qa-case-pack
157
170
  - defect-pack
158
171
  - issue-source
@@ -162,6 +175,7 @@ Direct mode starts from the user's explicit target. Workflow-only artifacts, app
162
175
 
163
176
  - verify-report
164
177
  - pass-fail-decision
178
+ - consumed-scenario-evidence
165
179
  - control-verification-result-when-triggered
166
180
  - updated-issues
167
181
 
@@ -22,6 +22,9 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
22
22
  - `ready-handoff`
23
23
  - `fixed-issues`
24
24
  - `test-cases`
25
+ - `scenario-catalog`
26
+ - `promoted-playwright-specs`
27
+ - `api-integration-evidence`
25
28
  - `qa-case-pack`
26
29
  - `defect-pack`
27
30
  - `issue-source`
@@ -31,6 +34,7 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
31
34
 
32
35
  - `verify-report`
33
36
  - `pass-fail-decision`
37
+ - `consumed-scenario-evidence`
34
38
  - `control-verification-result-when-triggered`
35
39
  - `updated-issues`
36
40
 
@@ -102,8 +106,8 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
102
106
 
103
107
  - `output_goal`: Independently confirm or reject the ready claim with replayable evidence.
104
108
  - `downstream_consumer`: Next legal ZSK stage or reviewer.
105
- - `required_inputs`: ready-handoff, fixed-issues, test-cases, qa-case-pack, defect-pack, issue-source, runtime-version
106
- - `required_outputs`: verify-report, pass-fail-decision, control-verification-result-when-triggered, updated-issues
109
+ - `required_inputs`: ready-handoff, fixed-issues, test-cases, scenario-catalog, promoted-playwright-specs, api-integration-evidence, qa-case-pack, defect-pack, issue-source, runtime-version
110
+ - `required_outputs`: verify-report, pass-fail-decision, consumed-scenario-evidence, control-verification-result-when-triggered, updated-issues
107
111
  - `must_answer_questions`: What exact claim was tested independently, and did it pass? / What commands/scenarios/artifacts prove the result? / Which issues are closed, reopened, or newly found?
108
112
  - `quality_checks`: Names consumed qa-case-pack/defect-pack facts or records why no reviewed pack applies. / Uses fresh evidence and reads command/scenario output before deciding. / Separates pass/fail decision from recommendations or follow-up improvements.
109
113
  - `anti_patterns`: Verifying by trusting the implementer's smoke report. / Closing issues without linking replay evidence.
@@ -199,6 +199,9 @@ skills:
199
199
  - ready-handoff
200
200
  - fixed-issues
201
201
  - test-cases
202
+ - scenario-catalog
203
+ - promoted-playwright-specs
204
+ - api-integration-evidence
202
205
  - qa-case-pack
203
206
  - defect-pack
204
207
  - issue-source
@@ -206,6 +209,7 @@ skills:
206
209
  outputs:
207
210
  - verify-report
208
211
  - pass-fail-decision
212
+ - consumed-scenario-evidence
209
213
  - control-verification-result-when-triggered
210
214
  - updated-issues
211
215
  tools: