@captain_z/zsk-skills 1.8.10 → 1.8.11
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/package.json +1 -1
- package/zsk-coding/SKILL.md +12 -5
- package/zsk-demo/SKILL.md +59 -18
- package/zsk-demo/harness/THIS_SKILL.md +11 -6
- package/zsk-demo/harness/workflow/skill-io-contract.yaml +11 -2
- package/zsk-smoke/SKILL.md +12 -5
- package/zsk-spec/SKILL.md +9 -4
- package/zsk-task/SKILL.md +14 -7
- package/zsk-verify/SKILL.md +22 -8
- package/zsk-verify/harness/THIS_SKILL.md +6 -2
- package/zsk-verify/harness/workflow/skill-io-contract.yaml +4 -0
package/package.json
CHANGED
package/zsk-coding/SKILL.md
CHANGED
|
@@ -63,11 +63,16 @@ Use this stage when tasks are approved for implementation. Coding owns small beh
|
|
|
63
63
|
- refactor only while GREEN, then rerun the affected focused test.
|
|
64
64
|
7. Add or update tests at the same risk level as the change; do not write all
|
|
65
65
|
tests first and then all implementation.
|
|
66
|
-
8.
|
|
67
|
-
|
|
68
|
-
|
|
69
|
-
|
|
70
|
-
|
|
66
|
+
8. When changed behavior maps to a scenario catalog or task scenario strategy,
|
|
67
|
+
create or update the smallest source-aligned test, integration check, API
|
|
68
|
+
check, or draft scenario needed by that layer. Do not promote browser drafts
|
|
69
|
+
or claim UI regression coverage without demo observation and locator
|
|
70
|
+
refinement.
|
|
71
|
+
9. For issue-driven `fix` work, update the issue with changed files, root cause, evidence commands, documentation feedback target or no-update rationale, and next verification route.
|
|
72
|
+
10. Run or cite fresh lint/typecheck/static diagnostics for the touched stack and confirm zero ESLint or TypeScript error/warning-level Problems before ready-for-smoke.
|
|
73
|
+
11. Produce a validation packet for meaningful behavior changes. Map every acceptance criterion to evidence, classify each evidence item as unit, integration, smoke, manual, static, or review, record mock boundaries, and mark contract tiers as intrinsic engineering, contextual spec/design/task, or workflow governance.
|
|
74
|
+
12. When an anchor packet is available, compare current implementation facts against intent, scope, acceptance criteria, design decisions, validation expectations, resource versions, and assumptions. Report local drift signals with class, severity, recommended workflow action, and confidence impact.
|
|
75
|
+
13. Record commands, evidence, blockers, changed files, per-behavior TDD cycles, validation packet status, drift signals, and any dynamic best-practice sources for `smoke`/`review`.
|
|
71
76
|
|
|
72
77
|
## Constraints
|
|
73
78
|
|
|
@@ -78,6 +83,8 @@ Use this stage when tasks are approved for implementation. Coding owns small beh
|
|
|
78
83
|
not replace per-behavior RED/GREEN evidence with one final large test result
|
|
79
84
|
set.
|
|
80
85
|
- No treating green unit tests as completion by themselves. If critical wiring is mocked, include integration, smoke, manual, or review evidence, or explicitly report the validation gap.
|
|
86
|
+
- No treating generated browser draft specs as regression evidence until demo
|
|
87
|
+
preflight supplies observation handoff and the draft is refined/promoted.
|
|
81
88
|
- No hiding placeholder code, hacks, broad refactors, style/type diagnostics, error-handling gaps, scope violations, or contract violations behind passing tests.
|
|
82
89
|
- No mutating workflow state from local drift findings. Report drift, blocker,
|
|
83
90
|
and issue-update payloads; the workflow or human decides sequencing and
|
package/zsk-demo/SKILL.md
CHANGED
|
@@ -58,16 +58,22 @@ negativeExamples:
|
|
|
58
58
|
|
|
59
59
|
# Demo
|
|
60
60
|
|
|
61
|
-
Development demo before formal testing. Build a module-grouped, audience-ready
|
|
61
|
+
Development demo before formal testing. Build a module-grouped, audience-ready
|
|
62
|
+
demo outline, generate a scenario catalog and test strategy from source inputs,
|
|
63
|
+
run browser preflight to capture low-token UI observation handoffs, rehearse
|
|
64
|
+
visible flows, record demo-only issues, preserve evidence, and promote reusable
|
|
65
|
+
Playwright scenarios only after locator refinement.
|
|
62
66
|
|
|
63
67
|
Default `/demo` execution follows the optimized SOP:
|
|
64
68
|
|
|
65
69
|
```text
|
|
66
|
-
tests.raw_cases / sources.testing
|
|
70
|
+
tests.raw_cases / sources.testing / spec / issue / manual notes / existing tests
|
|
71
|
+
-> scenario-catalog.json with sourceRefs, steps, expected results, and gaps
|
|
72
|
+
-> test-plan.json with automationStrategy by verification layer
|
|
67
73
|
-> UI observation handoff for current-page state and locator hints
|
|
68
|
-
->
|
|
69
|
-
->
|
|
70
|
-
-> Playwright Test/UI/debug execution and evidence
|
|
74
|
+
-> Playwright draft specs under `_playwright/drafts/*.pw-draft.ts`
|
|
75
|
+
-> refined promoted specs under `_playwright/specs/*.spec.ts`
|
|
76
|
+
-> Playwright Test/UI/debug execution and demo evidence
|
|
71
77
|
```
|
|
72
78
|
|
|
73
79
|
Use Playwright `storageState`, persistent context, CDP, or fixture login to reuse credentials before relying on live UI tools. For authenticated products, demo must solve login first: perform first-time login once, save module-local storageState under `.zsk/modules/{module}/_playwright/.auth/`, and make all generated specs fail fast with a clear auth bootstrap instruction instead of letting every business scenario fail on the login page. The project may declare `automation.demo.auth.envFiles` such as `~/.zshrc` and `automation.demo.auth.env` key names such as `username: DEMO_USERNAME`; never write credential values into `.zsk/config.yaml` or generated artifacts. Computer Use is the preferred current-page or visual observation lane when it is available and authorized. If Computer Use is unavailable, such as in runtimes that do not expose it, fall back to Playwright MCP/ARIA/CDP snapshots, deterministic Playwright inspection, documented manual evidence, or Browser Use only where the runtime explicitly supports it and permissions are available. Any UI observation tool is observation-only in this path: it may describe URL, page title, visible targets, role/label hints, auth/session notes, and privacy concerns, but it must not write repo artifacts, `test-plan.json`, or final `.spec.ts` files. Optimized `/demo` must not silently fall back to Playwright MCP or the legacy hybrid bridge.
|
|
@@ -101,7 +107,11 @@ Every demo step must have complete source alignment:
|
|
|
101
107
|
|
|
102
108
|
Do not include orphan demo steps that cannot be traced to those sources. Do not omit required function points from the PRD/SRS unless the omission is called out as a known gap with owner and reason.
|
|
103
109
|
|
|
104
|
-
If a formal test case and UI observation handoff are available, demo should
|
|
110
|
+
If a formal test case and UI observation handoff are available, demo should
|
|
111
|
+
generate or refresh a draft Playwright case before running it. Prefer
|
|
112
|
+
`scenario catalog + UI observation handoff + test-plan.json + Playwright draft`
|
|
113
|
+
over screenshot-only generation. Use the legacy hybrid lane explicitly when MCP
|
|
114
|
+
or non-default UI observation is required.
|
|
105
115
|
|
|
106
116
|
## Operating Constraints
|
|
107
117
|
|
|
@@ -130,7 +140,7 @@ demo run computer-use -> zsk demo run --computer-use
|
|
|
130
140
|
demo run hybrid -> zsk demo run --hybrid
|
|
131
141
|
demo auth -> zsk demo auth -m <module> --url <login-or-app-url>
|
|
132
142
|
demo capture -> zsk demo capture
|
|
133
|
-
demo scenario generate -> zsk demo scenario generate --
|
|
143
|
+
demo scenario generate -> zsk demo scenario generate --case-id <id> --observation <path>
|
|
134
144
|
demo complete -> zsk demo complete
|
|
135
145
|
```
|
|
136
146
|
|
|
@@ -150,7 +160,13 @@ Computer Use, Browser Use, or manual evidence outside optimized mode must record
|
|
|
150
160
|
The optimized lane exchanges structured artifacts:
|
|
151
161
|
|
|
152
162
|
- `test-plan.json`: source-aligned test intent, preconditions, UI observation summary, locator hints, steps, assertions, auth handoff, risks, and generated spec target.
|
|
153
|
-
-
|
|
163
|
+
- `scenario-catalog.json`: normalized scenarios from QA tables, markdown,
|
|
164
|
+
spec, issue notes, manual notes, and existing tests.
|
|
165
|
+
- `uiObservationHandoff`: tool-neutral observation payload from Agent Browser,
|
|
166
|
+
Browser Use, Computer Use, Playwright ARIA/CDP, or manual evidence.
|
|
167
|
+
- `.pw-draft.ts`: draft Playwright test with source alignment and locator hints.
|
|
168
|
+
- `.spec.ts`: promoted executable Playwright test after observation evidence and
|
|
169
|
+
locator refinement.
|
|
154
170
|
|
|
155
171
|
The legacy hybrid lane exchanges structured artifacts:
|
|
156
172
|
|
|
@@ -165,9 +181,13 @@ Demo has two sub-phases:
|
|
|
165
181
|
- Create a flow-first demo outline from PRD/SRS, spec/design, task, and test evidence before writing or running cases.
|
|
166
182
|
- Order function points by user/business journey, not by file order or resource order.
|
|
167
183
|
- Add a coverage alignment table that proves each demo step maps to the original requirement, design/spec contract, task scope, and expected test result.
|
|
168
|
-
-
|
|
184
|
+
- Agent Browser, Browser Use, Computer Use, Playwright ARIA/CDP, or manual
|
|
185
|
+
evidence captures current page, human goal, visible controls, and candidate
|
|
186
|
+
locators when deterministic scripts cannot infer intent by themselves.
|
|
169
187
|
- The agent combines UI observation state with SRS/spec/design rows, formal QA cases, automation/e2e cases, and unit-test assertions/fixtures that define expected behavior.
|
|
170
|
-
- Playwright pre-write cases are drafted under `.zsk/modules/{module}/_playwright/
|
|
188
|
+
- Playwright pre-write cases are drafted under `.zsk/modules/{module}/_playwright/drafts/` with explicit auth bootstrap, module-local storageState reuse, and candidate locator fallbacks.
|
|
189
|
+
- Promotion to `.zsk/modules/{module}/_playwright/specs/` requires a
|
|
190
|
+
`uiObservationHandoff`, refined locators, and `zsk check` compatibility.
|
|
171
191
|
- Playwright dry-runs or UI-runs the cases, recording trace/report/screenshots and pausing on selector/auth drift.
|
|
172
192
|
2. Demo Show:
|
|
173
193
|
- Use only the pre-written, already dry-run Playwright cases for external demonstration.
|
|
@@ -179,8 +199,11 @@ The handoff loop is:
|
|
|
179
199
|
1. Identify: Computer Use identifies the human goal, current page state, likely control to click/type, and candidate locators when Playwright cannot know which visible element matches the user's intent. If unavailable, use Playwright MCP/ARIA/CDP, manual evidence, or compatible Browser Use.
|
|
180
200
|
2. Persist state: zsk or the agent generator persists UI observations into `test-plan.json` or a separate handoff note before spec generation, including URL, candidate locator text, storage/session hint, profile source, visible login state, and privacy note. The observation tool itself is not the repo writer.
|
|
181
201
|
3. Pre-write: zsk or the agent generator converts source evidence plus UI observations into `test-plan.json` and then Playwright specs, preferring role-based locators and including any auth handoff that Playwright can reproduce.
|
|
182
|
-
4. Rehearse: Playwright runs the
|
|
183
|
-
|
|
202
|
+
4. Rehearse: Playwright runs the draft or promoted cases with `storageState`,
|
|
203
|
+
persistent context, CDP, or fixture login when available, then records
|
|
204
|
+
trace/UI/report evidence.
|
|
205
|
+
5. Perform: Demo Show uses rehearsed cases; only refined drafts with observation
|
|
206
|
+
evidence are promoted to reusable verify/regression scenarios.
|
|
184
207
|
|
|
185
208
|
Repeat the loop until the demo function point is passed, paused, or converted into a Demo Issue.
|
|
186
209
|
|
|
@@ -190,10 +213,18 @@ The agent should synthesize Playwright cases before the external demo from raw t
|
|
|
190
213
|
|
|
191
214
|
1. Load SRS/spec/design rows, formal QA cases, existing automation/e2e cases, and relevant unit-test assertions/fixtures.
|
|
192
215
|
2. Read Computer Use observation when current-page visual state or human-intent locator mapping is needed and available; otherwise use Playwright MCP/ARIA/CDP, documented manual evidence, or compatible Browser Use. Map auth to Playwright `storageState`, persistent context, CDP, or documented manual setup.
|
|
193
|
-
3. Generate `
|
|
194
|
-
|
|
195
|
-
|
|
196
|
-
|
|
216
|
+
3. Generate `scenario-catalog.json` and `test-plan.json` under
|
|
217
|
+
`_playwright/test-plans/` with source links, automation strategy, step intent,
|
|
218
|
+
locator hints, assertions, auth handoff, risks, and draft/promoted targets.
|
|
219
|
+
4. Generate a draft Playwright spec under `_playwright/drafts/` using role-first
|
|
220
|
+
locators, explicit auth bootstrap, persisted storageState reuse, and
|
|
221
|
+
assertions derived from source evidence.
|
|
222
|
+
5. Rehearse it with Playwright UI/trace/report evidence and preserve
|
|
223
|
+
trace/screenshots/video under `.zsk/modules/{module}/_playwright` or
|
|
224
|
+
`.zsk/modules/{module}/_evidence`.
|
|
225
|
+
6. Promote only after observation evidence and locator refinement; use the
|
|
226
|
+
rehearsed case for Demo Show and do not improvise new clicks during the
|
|
227
|
+
external demo unless the prepared case is blocked and recorded.
|
|
197
228
|
|
|
198
229
|
Playwright MCP and Browser Use are compatibility lanes, not assumptions. Computer Use is preferred for visual/current-page observation when available; all observation lanes remain observation-only in optimized mode.
|
|
199
230
|
|
|
@@ -204,6 +235,11 @@ zsk demo scenario generate \
|
|
|
204
235
|
-m checkout \
|
|
205
236
|
--test-case .zsk/raws/testing/checkout-happy-path.md \
|
|
206
237
|
--name "Checkout happy path"
|
|
238
|
+
|
|
239
|
+
zsk demo scenario generate \
|
|
240
|
+
-m checkout \
|
|
241
|
+
--case-id checkout-001 \
|
|
242
|
+
--observation .zsk/modules/checkout/_playwright/observations/checkout.agent-browser.json
|
|
207
243
|
```
|
|
208
244
|
|
|
209
245
|
## Session Lifecycle
|
|
@@ -270,15 +306,20 @@ Direct mode starts from the user's explicit target. Workflow-only artifacts, app
|
|
|
270
306
|
- tasks
|
|
271
307
|
- deployment
|
|
272
308
|
- test-cases
|
|
309
|
+
- scenario-catalog
|
|
273
310
|
- ui-observation-handoff
|
|
274
|
-
- playwright-
|
|
311
|
+
- draft-playwright-specs
|
|
275
312
|
|
|
276
313
|
**Required outputs**
|
|
277
314
|
|
|
278
315
|
- demo-outline
|
|
279
316
|
- demo-report
|
|
280
317
|
- demo-issues
|
|
281
|
-
-
|
|
318
|
+
- scenario-catalog
|
|
319
|
+
- test-plan
|
|
320
|
+
- ui-observation-handoff
|
|
321
|
+
- draft-playwright-specs
|
|
322
|
+
- promoted-playwright-specs
|
|
282
323
|
- playwright-execution
|
|
283
324
|
|
|
284
325
|
### Quality Rubric
|
|
@@ -24,15 +24,20 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
|
|
|
24
24
|
- `tasks`
|
|
25
25
|
- `deployment`
|
|
26
26
|
- `test-cases`
|
|
27
|
+
- `scenario-catalog`
|
|
27
28
|
- `ui-observation-handoff`
|
|
28
|
-
- `playwright-
|
|
29
|
+
- `draft-playwright-specs`
|
|
29
30
|
|
|
30
31
|
## Required Outputs
|
|
31
32
|
|
|
32
33
|
- `demo-outline`
|
|
33
34
|
- `demo-report`
|
|
34
35
|
- `demo-issues`
|
|
35
|
-
- `
|
|
36
|
+
- `scenario-catalog`
|
|
37
|
+
- `test-plan`
|
|
38
|
+
- `ui-observation-handoff`
|
|
39
|
+
- `draft-playwright-specs`
|
|
40
|
+
- `promoted-playwright-specs`
|
|
36
41
|
- `playwright-execution`
|
|
37
42
|
|
|
38
43
|
## Required Output Enforcement
|
|
@@ -43,8 +48,8 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
|
|
|
43
48
|
|
|
44
49
|
## Allowed Tools And Capabilities
|
|
45
50
|
|
|
46
|
-
- Tools: `playwright-cli`, `playwright-test`, `computer-use`, `playwright-mcp`, `browser-use`, `issue-create`
|
|
47
|
-
- Capabilities: `flow-first-demo`, `scenario-generation`, `visible-rehearsal`
|
|
51
|
+
- Tools: `playwright-cli`, `playwright-test`, `computer-use`, `playwright-mcp`, `browser-use`, `agent-browser`, `issue-create`
|
|
52
|
+
- Capabilities: `flow-first-demo`, `scenario-catalog-extraction`, `browser-preflight`, `scenario-generation`, `visible-rehearsal`, `scenario-promotion`
|
|
48
53
|
- Script policy: `recommended`
|
|
49
54
|
- Browser Use policy: `conditional`
|
|
50
55
|
|
|
@@ -103,8 +108,8 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
|
|
|
103
108
|
|
|
104
109
|
- `output_goal`: Rehearse user-visible flows from source-backed scenarios and capture demo evidence.
|
|
105
110
|
- `downstream_consumer`: Next legal ZSK stage or reviewer.
|
|
106
|
-
- `required_inputs`: spec, design, tasks, deployment, test-cases, ui-observation-handoff, playwright-
|
|
107
|
-
- `required_outputs`: demo-outline, demo-report, demo-issues,
|
|
111
|
+
- `required_inputs`: spec, design, tasks, deployment, test-cases, scenario-catalog, ui-observation-handoff, draft-playwright-specs
|
|
112
|
+
- `required_outputs`: demo-outline, demo-report, demo-issues, scenario-catalog, test-plan, ui-observation-handoff, draft-playwright-specs, promoted-playwright-specs, playwright-execution
|
|
108
113
|
- `must_answer_questions`: Which scenario, account/state, route, and expected observable result were exercised? / What was visible to the user, and what evidence was captured? / Which demo gaps become defects or task/spec/design feedback?
|
|
109
114
|
- `quality_checks`: Consumes spec scenarios and task case skeletons instead of inventing flows during demo. / Records storageState path, first-login/bootstrap path, and explicit public-flow waiver when auth is not required. / Records screenshots/traces/logs where they materially prove visible behavior.
|
|
110
115
|
- `anti_patterns`: Manual click-through notes with no scenario linkage. / Treating login/setup failure as an app defect without classification.
|
|
@@ -201,13 +201,18 @@ skills:
|
|
|
201
201
|
- tasks
|
|
202
202
|
- deployment
|
|
203
203
|
- test-cases
|
|
204
|
+
- scenario-catalog
|
|
204
205
|
- ui-observation-handoff
|
|
205
|
-
- playwright-
|
|
206
|
+
- draft-playwright-specs
|
|
206
207
|
outputs:
|
|
207
208
|
- demo-outline
|
|
208
209
|
- demo-report
|
|
209
210
|
- demo-issues
|
|
210
|
-
-
|
|
211
|
+
- scenario-catalog
|
|
212
|
+
- test-plan
|
|
213
|
+
- ui-observation-handoff
|
|
214
|
+
- draft-playwright-specs
|
|
215
|
+
- promoted-playwright-specs
|
|
211
216
|
- playwright-execution
|
|
212
217
|
tools:
|
|
213
218
|
- playwright-cli
|
|
@@ -215,10 +220,14 @@ skills:
|
|
|
215
220
|
- computer-use
|
|
216
221
|
- playwright-mcp
|
|
217
222
|
- browser-use
|
|
223
|
+
- agent-browser
|
|
218
224
|
- issue-create
|
|
219
225
|
capabilities:
|
|
220
226
|
- flow-first-demo
|
|
227
|
+
- scenario-catalog-extraction
|
|
228
|
+
- browser-preflight
|
|
221
229
|
- scenario-generation
|
|
222
230
|
- visible-rehearsal
|
|
231
|
+
- scenario-promotion
|
|
223
232
|
script: recommended
|
|
224
233
|
browserUse: conditional
|
package/zsk-smoke/SKILL.md
CHANGED
|
@@ -49,6 +49,9 @@ implementation, review, release, or acceptance work.
|
|
|
49
49
|
|
|
50
50
|
Smoke is the developer-owned proof that changed behavior works well enough to be
|
|
51
51
|
inspected further when a workflow or human chooses to do so.
|
|
52
|
+
Smoke runs targeted checks for changed behavior. It does not require a full E2E
|
|
53
|
+
suite unless the changed behavior itself can only be credibly smoke-proved
|
|
54
|
+
through a focused browser/API/integration path.
|
|
52
55
|
|
|
53
56
|
## Inputs
|
|
54
57
|
|
|
@@ -61,11 +64,15 @@ inspected further when a workflow or human chooses to do so.
|
|
|
61
64
|
## Procedure
|
|
62
65
|
|
|
63
66
|
1. Confirm each targeted test or scenario maps to the intended requirement, function point, and expected behavior.
|
|
64
|
-
2.
|
|
65
|
-
|
|
66
|
-
|
|
67
|
-
|
|
68
|
-
|
|
67
|
+
2. Use the scenario catalog or task strategy when present to select the narrowest
|
|
68
|
+
credible layer: unit, integration, api-e2e, browser-e2e, visual-observation,
|
|
69
|
+
or manual-blocker.
|
|
70
|
+
3. Run targeted tests for changed behavior first.
|
|
71
|
+
4. Run lint/typecheck/build/smoke checks when relevant to the touched surface.
|
|
72
|
+
5. Capture exact commands, environment, results, source alignment, and evidence links.
|
|
73
|
+
6. Classify passed, failed, skipped, flaky, unrun, and N/A checks explicitly.
|
|
74
|
+
7. Convert failures into coding fixes or smoke issues with repro command, actual/expected behavior, severity, root-cause hypothesis, and regression guard.
|
|
75
|
+
8. For `fix` routes, record whether the smoke command exercises the original issue reproduction, the regression guard, or both.
|
|
69
76
|
|
|
70
77
|
## Constraints
|
|
71
78
|
|
package/zsk-spec/SKILL.md
CHANGED
|
@@ -101,18 +101,23 @@ Conditional hard requirements: when the behavior touches auth, permissions, role
|
|
|
101
101
|
|
|
102
102
|
Advisory guidance: keep IDs stable, keep implementation choices out unless they are product contract, and write `未指定` for unsupplied thresholds.
|
|
103
103
|
|
|
104
|
-
##
|
|
104
|
+
## Observable Scenario Contract
|
|
105
105
|
|
|
106
|
-
For
|
|
106
|
+
For important behavior, spec should define observable scenario contracts before
|
|
107
|
+
implementation. These contracts are the source for a later scenario catalog;
|
|
108
|
+
they are not executable selector plans.
|
|
107
109
|
|
|
108
110
|
- user-visible goal
|
|
109
111
|
- route/page entry
|
|
110
112
|
- role/account/data preconditions
|
|
111
113
|
- observable success/failure states
|
|
112
114
|
- AC/FR linkage
|
|
113
|
-
-
|
|
115
|
+
- preferred verification layer when known: browser-e2e, api-e2e, integration,
|
|
116
|
+
unit, visual-observation, or manual-blocker
|
|
117
|
+
- whether the scenario is a smoke/demo/verify/regression candidate
|
|
114
118
|
|
|
115
|
-
Do not write brittle selectors in spec. Save locator strategy
|
|
119
|
+
Do not write brittle selectors in spec. Save locator strategy, runtime evidence,
|
|
120
|
+
and browser observation details for design/task/demo.
|
|
116
121
|
|
|
117
122
|
## Outputs
|
|
118
123
|
|
package/zsk-task/SKILL.md
CHANGED
|
@@ -144,15 +144,20 @@ hierarchy syncs as `parent-child` links. Multica, Jira, GitHub Issues, GitLab,
|
|
|
144
144
|
Linear, or future providers remain adapter outputs of `zsk work sync --dry-run`.
|
|
145
145
|
Task does not assign or start agents.
|
|
146
146
|
|
|
147
|
-
##
|
|
147
|
+
## Scenario Strategy Output
|
|
148
148
|
|
|
149
|
-
Task planning should
|
|
149
|
+
Task planning should map important scenarios to verification layers and evidence
|
|
150
|
+
hooks before demo:
|
|
150
151
|
|
|
151
|
-
- map each P0/P1 scenario contract to
|
|
152
|
+
- map each P0/P1 scenario contract to browser-e2e, api-e2e, integration, unit,
|
|
153
|
+
visual-observation, or manual-blocker
|
|
152
154
|
- define fixture/auth/bootstrap needs
|
|
153
|
-
- mark which
|
|
155
|
+
- mark which scenarios are smoke/demo, verify, or regression candidates
|
|
156
|
+
- point demo candidates at `.zsk/modules/{module}/_playwright/drafts/` for
|
|
157
|
+
draft Playwright generation, not promoted specs
|
|
154
158
|
- include implementation tasks for missing labels/test ids needed by stable locators
|
|
155
|
-
- ensure demo consumes
|
|
159
|
+
- ensure demo consumes scenario contracts, test-plan strategy, and observation
|
|
160
|
+
handoffs instead of inventing flows during the meeting
|
|
156
161
|
|
|
157
162
|
## Scenario Synthesis
|
|
158
163
|
|
|
@@ -163,7 +168,9 @@ When structured page information is available from Playwright MCP, Accessibility
|
|
|
163
168
|
- design locator/state strategy
|
|
164
169
|
- structured page information
|
|
165
170
|
|
|
166
|
-
The result should be a reviewable Playwright spec
|
|
171
|
+
The result should be a reviewable draft Playwright spec or scenario plan, not an
|
|
172
|
+
unreviewed promoted test. Demo executes, observes, rehearses, and calibrates it
|
|
173
|
+
later; promotion requires refined locators and observation evidence.
|
|
167
174
|
|
|
168
175
|
## Outputs
|
|
169
176
|
|
|
@@ -175,7 +182,7 @@ The result should be a reviewable Playwright spec skeleton, not an unreviewed fi
|
|
|
175
182
|
qa-case-pack claims, mapped tasks, evidence route, and blocker/N/A rationale.
|
|
176
183
|
- Control-row task coverage matrix when triggered.
|
|
177
184
|
- FR/AC coverage matrix.
|
|
178
|
-
- Playwright
|
|
185
|
+
- Scenario strategy matrix and draft Playwright targets or documented non-UI reason.
|
|
179
186
|
- Work-event preview for every provider-syncable task group and subtask,
|
|
180
187
|
including expected `work.item.upserted` and `work.item.linked` records, or a
|
|
181
188
|
`work-task-emit` evidence plan explaining blocked or unchanged task items.
|
package/zsk-verify/SKILL.md
CHANGED
|
@@ -45,6 +45,8 @@ workflow route.
|
|
|
45
45
|
- Ready-for-verify handoff.
|
|
46
46
|
- Linked issues, reproduction steps, expected outcomes, and evidence.
|
|
47
47
|
- Deployment/version information and reusable scenarios.
|
|
48
|
+
- Scenario catalog, promoted Playwright specs, API/integration evidence, demo
|
|
49
|
+
evidence, defect packs, and ready handoff when present.
|
|
48
50
|
- `qa-case-pack`, `defect-pack`, and issue-source records when reviewed
|
|
49
51
|
readiness packs exist.
|
|
50
52
|
- For issue-driven `fix` routes: issue path/id, root-cause note, changed files, regression guard, and smoke/review evidence.
|
|
@@ -52,25 +54,31 @@ workflow route.
|
|
|
52
54
|
## Procedure
|
|
53
55
|
|
|
54
56
|
1. Restate the claim being verified and the smallest proof needed.
|
|
55
|
-
2.
|
|
56
|
-
|
|
57
|
+
2. Load applicable replay sources: scenario catalog, promoted browser specs,
|
|
58
|
+
API/integration evidence, qa-case-pack, defect-pack, demo report, and ready
|
|
59
|
+
handoff. Record which were consumed or why none applied.
|
|
60
|
+
3. Re-run reproduction or acceptance checks independently.
|
|
61
|
+
4. When `qa-case-pack` or `defect-pack` exists, compare actual behavior to its
|
|
57
62
|
reviewed expected/actual/test-basis facts and sourceRefs before considering
|
|
58
63
|
provider status, tracker labels, or implementation claims.
|
|
59
|
-
|
|
60
|
-
|
|
61
|
-
|
|
62
|
-
|
|
64
|
+
5. Compare actual behavior to spec/issue expectations.
|
|
65
|
+
6. Record pass/fail evidence with commands, screenshots, traces, or manual notes.
|
|
66
|
+
7. Classify failures by likely owner and recommended action based on root cause.
|
|
67
|
+
8. When verification fails, return an issue-update payload with repro,
|
|
63
68
|
actual/expected, severity, root cause, and documentation feedback target.
|
|
64
|
-
|
|
69
|
+
9. When verification passes, return a verified issue-update payload with
|
|
65
70
|
evidence, while leaving spec/design feedback pending until the user/product
|
|
66
71
|
owner confirms the fix is acceptable.
|
|
67
|
-
|
|
72
|
+
10. For `fix` routes, confirm that the issue record contains a documentation feedback target or no-update rationale before recommending closure.
|
|
68
73
|
|
|
69
74
|
## Constraints
|
|
70
75
|
|
|
71
76
|
- Do not accept developer evidence without independent checking when independence is required.
|
|
72
77
|
- Do not verify against an unversioned or unknown environment.
|
|
73
78
|
- Do not broaden the scope beyond linked claims.
|
|
79
|
+
- Do not invent new test scope, new scenarios, or locator strategy during
|
|
80
|
+
verify. If coverage is missing, record a blocker/gap and route it back to
|
|
81
|
+
task/demo/coding.
|
|
74
82
|
- Do not mark pass with missing evidence.
|
|
75
83
|
- Do not verify from provider status alone when reviewed qa-case-pack or
|
|
76
84
|
defect-pack facts are available.
|
|
@@ -83,6 +91,8 @@ workflow route.
|
|
|
83
91
|
- Pass/fail decision per issue/AC.
|
|
84
92
|
- QA/defect pack consumption result when applicable: sourceRefs checked,
|
|
85
93
|
expected/actual basis, assumptions, blockers, and replay evidence.
|
|
94
|
+
- Scenario catalog / promoted spec / demo evidence consumption result when
|
|
95
|
+
applicable, or a recorded reason none applied.
|
|
86
96
|
- Acceptance readiness or failure classification.
|
|
87
97
|
- Issue-update payload and documentation feedback target.
|
|
88
98
|
|
|
@@ -153,6 +163,9 @@ Direct mode starts from the user's explicit target. Workflow-only artifacts, app
|
|
|
153
163
|
- ready-handoff
|
|
154
164
|
- fixed-issues
|
|
155
165
|
- test-cases
|
|
166
|
+
- scenario-catalog
|
|
167
|
+
- promoted-playwright-specs
|
|
168
|
+
- api-integration-evidence
|
|
156
169
|
- qa-case-pack
|
|
157
170
|
- defect-pack
|
|
158
171
|
- issue-source
|
|
@@ -162,6 +175,7 @@ Direct mode starts from the user's explicit target. Workflow-only artifacts, app
|
|
|
162
175
|
|
|
163
176
|
- verify-report
|
|
164
177
|
- pass-fail-decision
|
|
178
|
+
- consumed-scenario-evidence
|
|
165
179
|
- control-verification-result-when-triggered
|
|
166
180
|
- updated-issues
|
|
167
181
|
|
|
@@ -22,6 +22,9 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
|
|
|
22
22
|
- `ready-handoff`
|
|
23
23
|
- `fixed-issues`
|
|
24
24
|
- `test-cases`
|
|
25
|
+
- `scenario-catalog`
|
|
26
|
+
- `promoted-playwright-specs`
|
|
27
|
+
- `api-integration-evidence`
|
|
25
28
|
- `qa-case-pack`
|
|
26
29
|
- `defect-pack`
|
|
27
30
|
- `issue-source`
|
|
@@ -31,6 +34,7 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
|
|
|
31
34
|
|
|
32
35
|
- `verify-report`
|
|
33
36
|
- `pass-fail-decision`
|
|
37
|
+
- `consumed-scenario-evidence`
|
|
34
38
|
- `control-verification-result-when-triggered`
|
|
35
39
|
- `updated-issues`
|
|
36
40
|
|
|
@@ -102,8 +106,8 @@ This full contract is generated for workflow or strict-profile runs. Direct sing
|
|
|
102
106
|
|
|
103
107
|
- `output_goal`: Independently confirm or reject the ready claim with replayable evidence.
|
|
104
108
|
- `downstream_consumer`: Next legal ZSK stage or reviewer.
|
|
105
|
-
- `required_inputs`: ready-handoff, fixed-issues, test-cases, qa-case-pack, defect-pack, issue-source, runtime-version
|
|
106
|
-
- `required_outputs`: verify-report, pass-fail-decision, control-verification-result-when-triggered, updated-issues
|
|
109
|
+
- `required_inputs`: ready-handoff, fixed-issues, test-cases, scenario-catalog, promoted-playwright-specs, api-integration-evidence, qa-case-pack, defect-pack, issue-source, runtime-version
|
|
110
|
+
- `required_outputs`: verify-report, pass-fail-decision, consumed-scenario-evidence, control-verification-result-when-triggered, updated-issues
|
|
107
111
|
- `must_answer_questions`: What exact claim was tested independently, and did it pass? / What commands/scenarios/artifacts prove the result? / Which issues are closed, reopened, or newly found?
|
|
108
112
|
- `quality_checks`: Names consumed qa-case-pack/defect-pack facts or records why no reviewed pack applies. / Uses fresh evidence and reads command/scenario output before deciding. / Separates pass/fail decision from recommendations or follow-up improvements.
|
|
109
113
|
- `anti_patterns`: Verifying by trusting the implementer's smoke report. / Closing issues without linking replay evidence.
|
|
@@ -199,6 +199,9 @@ skills:
|
|
|
199
199
|
- ready-handoff
|
|
200
200
|
- fixed-issues
|
|
201
201
|
- test-cases
|
|
202
|
+
- scenario-catalog
|
|
203
|
+
- promoted-playwright-specs
|
|
204
|
+
- api-integration-evidence
|
|
202
205
|
- qa-case-pack
|
|
203
206
|
- defect-pack
|
|
204
207
|
- issue-source
|
|
@@ -206,6 +209,7 @@ skills:
|
|
|
206
209
|
outputs:
|
|
207
210
|
- verify-report
|
|
208
211
|
- pass-fail-decision
|
|
212
|
+
- consumed-scenario-evidence
|
|
209
213
|
- control-verification-result-when-triggered
|
|
210
214
|
- updated-issues
|
|
211
215
|
tools:
|