yam-flow 2.0.0 → 2.2.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/AGENTS.md +7 -5
- package/CHANGELOG.md +26 -0
- package/COMMANDS.md +10 -4
- package/DECISIONS.md +3 -0
- package/README.md +17 -9
- package/dist/bin/yam.js +211 -30
- package/dist/lib/trust-kernel.d.ts +31 -1
- package/dist/lib/trust-kernel.js +128 -6
- package/package.json +2 -1
- package/references/final-report.md +17 -11
- package/references/honest-completion.md +13 -0
- package/references/study-note.md +69 -0
- package/references/tool-trust-layer.md +6 -1
- package/references/ueye-proof.md +42 -1
- package/references/ueye.md +29 -3
- package/references/verification-levels.md +130 -25
- package/skills/deep/SKILL.md +10 -2
- package/skills/mission/SKILL.md +10 -1
- package/skills/quick/SKILL.md +6 -2
- package/skills/ueye/SKILL.md +5 -1
- package/src/bin/yam.ts +217 -31
- package/src/lib/trust-kernel.ts +155 -7
- package/templates/yam.project.md +5 -1
- package/yam.manifest.json +6 -3
|
@@ -1,53 +1,158 @@
|
|
|
1
|
-
# Verification
|
|
1
|
+
# Verification Ladder
|
|
2
2
|
|
|
3
|
-
|
|
3
|
+
`yam` starts with momentum, but it is not lightweight-only. Verification should become heavier when scope, risk, public release, runtime state, UI completion, auth, DB, broad refactor, or user intent makes false completion costly.
|
|
4
4
|
|
|
5
|
-
|
|
5
|
+
Use the smallest level that honestly supports the claim, then escalate deliberately.
|
|
6
|
+
|
|
7
|
+
## L0: Stated
|
|
8
|
+
|
|
9
|
+
Explanation only. No code or artifact was inspected deeply enough to support an implementation claim.
|
|
10
|
+
|
|
11
|
+
Use for:
|
|
12
|
+
|
|
13
|
+
- Pure Q&A.
|
|
14
|
+
- Early plan or hypothesis.
|
|
15
|
+
- Scout recommendation before implementation.
|
|
16
|
+
|
|
17
|
+
Report:
|
|
18
|
+
|
|
19
|
+
- Truth status: `assumed` or `skipped`.
|
|
20
|
+
- Say no verification ran.
|
|
21
|
+
|
|
22
|
+
## L1: Inspected
|
|
23
|
+
|
|
24
|
+
Relevant file, snippet, error, screenshot, or project context was read.
|
|
25
|
+
|
|
26
|
+
Use for:
|
|
27
|
+
|
|
28
|
+
- Tiny docs/copy/config edits.
|
|
29
|
+
- Local explanation based on source reading.
|
|
30
|
+
- First pass on a small bug.
|
|
6
31
|
|
|
7
32
|
Expected:
|
|
8
33
|
|
|
9
|
-
- Re-read the changed
|
|
34
|
+
- Re-read the changed snippet.
|
|
10
35
|
- Check local project fit.
|
|
11
|
-
- Report that no command
|
|
36
|
+
- Report that no command ran if none did.
|
|
12
37
|
|
|
13
|
-
|
|
38
|
+
Truth cap:
|
|
14
39
|
|
|
15
|
-
|
|
40
|
+
- Usually `partial` or `assumed`, not `verified`.
|
|
41
|
+
|
|
42
|
+
## L2: Local Check
|
|
43
|
+
|
|
44
|
+
One focused local check supports the claim.
|
|
45
|
+
|
|
46
|
+
Use for:
|
|
47
|
+
|
|
48
|
+
- Small TS/JS/app logic changes.
|
|
49
|
+
- Narrow bug fixes.
|
|
50
|
+
- Focused build/type/lint/test failures.
|
|
16
51
|
|
|
17
52
|
Examples:
|
|
18
53
|
|
|
19
|
-
- One focused test.
|
|
20
54
|
- Typecheck.
|
|
21
55
|
- Lint for touched area.
|
|
56
|
+
- One focused test.
|
|
57
|
+
- Small CLI smoke for the touched command.
|
|
58
|
+
|
|
59
|
+
Truth cap:
|
|
60
|
+
|
|
61
|
+
- `verified` only for the checked surface.
|
|
62
|
+
|
|
63
|
+
## L3: Integrated
|
|
22
64
|
|
|
23
|
-
|
|
65
|
+
The change was checked through a broader local workflow or user-facing path.
|
|
24
66
|
|
|
25
|
-
|
|
67
|
+
Use for:
|
|
68
|
+
|
|
69
|
+
- Feature-sized work.
|
|
70
|
+
- Package-facing CLI changes.
|
|
71
|
+
- UI changes with visible behavior.
|
|
72
|
+
- Changes that affect multiple files or flows.
|
|
26
73
|
|
|
27
74
|
Examples:
|
|
28
75
|
|
|
29
|
-
-
|
|
30
|
-
-
|
|
76
|
+
- Build.
|
|
77
|
+
- CLI smoke.
|
|
78
|
+
- Relevant workflow command.
|
|
79
|
+
- Browser check or screenshot.
|
|
80
|
+
- UI state/responsive check.
|
|
31
81
|
|
|
32
|
-
|
|
82
|
+
Truth cap:
|
|
33
83
|
|
|
34
|
-
|
|
84
|
+
- `verified` for the exercised workflow.
|
|
85
|
+
- `partial` when important states, devices, or integrations remain untested.
|
|
35
86
|
|
|
36
|
-
|
|
87
|
+
## L4: Release / Runtime / Visual Proof
|
|
37
88
|
|
|
38
|
-
|
|
39
|
-
- Mobile viewport check.
|
|
40
|
-
- Check overflow, alignment, contrast, density, and core states.
|
|
89
|
+
Proof artifact or runtime/visual/release evidence supports the claim.
|
|
41
90
|
|
|
42
|
-
|
|
91
|
+
Use for:
|
|
43
92
|
|
|
44
|
-
|
|
93
|
+
- Public release readiness.
|
|
94
|
+
- Runtime process claims.
|
|
95
|
+
- Cleanup claims.
|
|
96
|
+
- Browser or screenshot visual verification.
|
|
97
|
+
- Auth/payment/DB/deployment/security-sensitive changes.
|
|
45
98
|
|
|
46
99
|
Examples:
|
|
47
100
|
|
|
48
|
-
-
|
|
49
|
-
-
|
|
50
|
-
-
|
|
51
|
-
-
|
|
52
|
-
-
|
|
101
|
+
- `yam release report --json`.
|
|
102
|
+
- Runtime evidence with process, port, URL, or cleanup observation.
|
|
103
|
+
- Ueye visual report with screenshot/provenance.
|
|
104
|
+
- DB/security readiness report.
|
|
105
|
+
- Readiness receipt or proof bundle.
|
|
106
|
+
|
|
107
|
+
Truth cap:
|
|
108
|
+
|
|
109
|
+
- `proven` only when runtime/process evidence exists.
|
|
110
|
+
- `verified` only when the relevant check actually passed.
|
|
111
|
+
- `blocked` when auth/tool/runtime evidence is required but unavailable.
|
|
112
|
+
|
|
113
|
+
## L5: Bounded Deep
|
|
114
|
+
|
|
115
|
+
Multiple relevant checks are combined, with a stop condition, skipped checks, residual risk, and handoff.
|
|
116
|
+
|
|
117
|
+
Use for:
|
|
118
|
+
|
|
119
|
+
- Broad refactors.
|
|
120
|
+
- Release candidates.
|
|
121
|
+
- Risky auth/payment/DB/runtime/deployment work.
|
|
122
|
+
- User-requested deep verification.
|
|
123
|
+
- Work with high learning value or high false-completion cost.
|
|
124
|
+
|
|
125
|
+
Expected:
|
|
126
|
+
|
|
127
|
+
- Define acceptance criteria.
|
|
128
|
+
- Run the relevant set of checks, not every possible check.
|
|
129
|
+
- Record proof summary or proof bundle lite.
|
|
130
|
+
- List skipped checks and why.
|
|
131
|
+
- List residual risks and remaining tasks.
|
|
132
|
+
|
|
133
|
+
Stop condition:
|
|
134
|
+
|
|
135
|
+
- Stop after the smallest meaningful verification set has passed, or after three relevant checks have run and any remaining uncertainty is clearly listed as blocked/remaining work.
|
|
136
|
+
- Stop earlier when the same blocker repeats, a required tool/auth/runtime is unavailable, or a user decision is needed.
|
|
137
|
+
- Do not keep retrying the same failure. Classify `failure_cause`, give `recovery_hint`, and hand off.
|
|
138
|
+
|
|
139
|
+
## Route Defaults
|
|
140
|
+
|
|
141
|
+
- `$question`: L0-L1.
|
|
142
|
+
- `$scout`: L0-L1 for judgment; source-backed but not implementation verification.
|
|
143
|
+
- `$quick`: L1-L2 by default; L3 only when the claim needs it.
|
|
144
|
+
- `$ueye`: L1-L3 for ordinary UI work; L4 when claiming visual done.
|
|
145
|
+
- `$deep`: L3-L5 when risk or user intent calls for strong verification.
|
|
146
|
+
- `$mission`: L4-L5 when real subagents/team lanes are used, with cross-verification.
|
|
147
|
+
|
|
148
|
+
## Completion Claim Rule
|
|
149
|
+
|
|
150
|
+
Completion claims require evidence at or above the level implied by the claim:
|
|
151
|
+
|
|
152
|
+
- Code changed: at least L1, preferably L2.
|
|
153
|
+
- User-facing behavior changed: L2-L3.
|
|
154
|
+
- UI done claim: L3-L4 with visual evidence when feasible.
|
|
155
|
+
- Runtime/cleanup claim: L4.
|
|
156
|
+
- Release/auth/DB/security claim: L4-L5.
|
|
53
157
|
|
|
158
|
+
If the evidence level is lower than the claim, lower the truth status and report the gap.
|
package/skills/deep/SKILL.md
CHANGED
|
@@ -43,7 +43,7 @@ Use for:
|
|
|
43
43
|
|
|
44
44
|
## Verification
|
|
45
45
|
|
|
46
|
-
Use
|
|
46
|
+
Use L3-L5 from `references/verification-levels.md`; pick the smallest bounded set that honestly supports the claim.
|
|
47
47
|
Use `references/token-economy.md`; wider context is allowed only when tied to the risk surface.
|
|
48
48
|
Use `references/context-reuse.md`; update stale project packs narrowly when needed.
|
|
49
49
|
Use `references/markdown-management.md` before writing broad proof or direction markdown.
|
|
@@ -52,6 +52,7 @@ Use `references/db-supabase-safety-lite.md` for destructive DB/Supabase, migrati
|
|
|
52
52
|
Use `references/current-docs.md` when SDK/API/cloud-service behavior may be current or version-sensitive.
|
|
53
53
|
Use `references/trust-kernel.md` when the task asks how yam prevents false completion or fake real proof claims.
|
|
54
54
|
Use `references/honest-completion.md`; do not overclaim verification, runtime, cleanup, or visual proof.
|
|
55
|
+
Use `references/study-note.md` when any code, config, docs, release metadata, or project artifact changed; include role, execution point, before/after, expected behavior, one syntax/structure insight, verification, limits, and architecture hygiene when relevant.
|
|
55
56
|
Use `references/final-report.md` to close with remaining tasks and fix-first items when useful.
|
|
56
57
|
Use `references/token-budget-reporter.md` when a run needs measured budget feedback.
|
|
57
58
|
|
|
@@ -65,12 +66,19 @@ Deep verification may include:
|
|
|
65
66
|
- Before/after screenshot.
|
|
66
67
|
- Risk-specific manual inspection.
|
|
67
68
|
|
|
69
|
+
Stop condition:
|
|
70
|
+
|
|
71
|
+
- Stop after the smallest meaningful verification set has passed, or after three relevant checks have run and the remaining uncertainty is clearly listed as blocked/remaining work.
|
|
72
|
+
- Stop earlier when the same blocker repeats, a required tool/auth/runtime is unavailable, or a user decision is needed.
|
|
73
|
+
- Do not keep retrying the same failure; classify the cause, give a recovery hint, and hand off.
|
|
74
|
+
|
|
68
75
|
## Final Response
|
|
69
76
|
|
|
70
77
|
Include:
|
|
71
78
|
|
|
72
79
|
- What was changed or reviewed.
|
|
73
|
-
- Study Note for
|
|
80
|
+
- Study Note for changed artifacts: what changed, what role it has, where it runs or is read, what was wrong or missing, before/after behavior, what behavior is expected, one useful syntax/structure insight, what was verified, and what remains uncertain.
|
|
81
|
+
- Architecture hygiene when relevant: flag if the change risks dumping unrelated logic into `page.tsx`, one-off component CSS into `global.css`, or structured product data into broad DB `jsonb` blobs.
|
|
74
82
|
- Evidence gathered.
|
|
75
83
|
- Truth status.
|
|
76
84
|
- Blockers or remaining risk.
|
package/skills/mission/SKILL.md
CHANGED
|
@@ -58,6 +58,12 @@ Do not use for:
|
|
|
58
58
|
12. Confirm cleanup or explicitly report intentionally running processes.
|
|
59
59
|
13. Produce final proof summary, truth status, remaining tasks, and fix-first items.
|
|
60
60
|
|
|
61
|
+
Mission stop condition:
|
|
62
|
+
|
|
63
|
+
- Stop after cross-verification and the smallest meaningful L4-L5 proof set have passed, or after three relevant checks have run and remaining uncertainty is recorded as blocked/remaining work.
|
|
64
|
+
- Stop earlier when the same blocker repeats, a required tool/auth/runtime is unavailable, or a user decision is needed.
|
|
65
|
+
- Do not keep retrying the same failure; classify the cause, give a recovery hint, and hand off.
|
|
66
|
+
|
|
61
67
|
## Proof Summary
|
|
62
68
|
|
|
63
69
|
Include:
|
|
@@ -79,7 +85,9 @@ Use `references/runtime-orchestration.md` only when runtime evidence is needed.
|
|
|
79
85
|
Use `references/doctor-scan.md` before final mission completion.
|
|
80
86
|
Use `references/db-supabase-safety-lite.md` for destructive DB/Supabase, migration, production-write, or RLS/policy lanes.
|
|
81
87
|
Use `references/current-docs.md` when any lane depends on current SDK/API/cloud-service behavior.
|
|
88
|
+
Use `references/verification-levels.md` for L4-L5 mission proof boundaries.
|
|
82
89
|
Use `references/honest-completion.md`; do not overclaim.
|
|
90
|
+
Use `references/study-note.md` for every lane that changes code, config, docs, release metadata, or project artifacts; include role, execution point, before/after, expected behavior, one syntax/structure insight, verification, limits, and architecture hygiene when relevant.
|
|
83
91
|
Use `references/final-report.md` to close with remaining tasks and fix-first items.
|
|
84
92
|
Use `references/token-budget-reporter.md` when budget drift matters.
|
|
85
93
|
|
|
@@ -102,7 +110,8 @@ Report:
|
|
|
102
110
|
|
|
103
111
|
- What the mission changed.
|
|
104
112
|
- Role/cross-verification summary.
|
|
105
|
-
- Study Note for
|
|
113
|
+
- Study Note for any lane that changed code, config, docs, release metadata, or project artifacts: what changed, what role it has, where it runs or is read, what was wrong or missing, before/after behavior, what behavior is expected, one useful syntax/structure insight, what was verified, and what remains uncertain.
|
|
114
|
+
- Architecture hygiene when relevant: flag if the change risks dumping unrelated logic into `page.tsx`, one-off component CSS into `global.css`, or structured product data into broad DB `jsonb` blobs.
|
|
106
115
|
- Evidence gathered.
|
|
107
116
|
- Truth status.
|
|
108
117
|
- Cleanup status.
|
package/skills/quick/SKILL.md
CHANGED
|
@@ -58,16 +58,19 @@ Scan lane:
|
|
|
58
58
|
|
|
59
59
|
## Verification
|
|
60
60
|
|
|
61
|
-
- Copy/CSS/docs:
|
|
61
|
+
- Copy/CSS/docs: L1 is often enough after re-reading the changed snippet.
|
|
62
62
|
- TS/JS or app logic: prefer typecheck, related test, lint, or build in that order when available.
|
|
63
63
|
- Build-fix: use a compact PASS/FAIL matrix for command results.
|
|
64
64
|
- If verification is skipped, partial, blocked, or assumed, say that plainly.
|
|
65
|
+
- Escalate beyond L2 only when the changed behavior, user-facing impact, or risk surface needs it.
|
|
65
66
|
|
|
66
67
|
Use `references/quick.md` for the merged fast/build rules.
|
|
68
|
+
Use `references/verification-levels.md` for the L0-L5 ladder.
|
|
67
69
|
Use `references/truth-matrix.md` for truth labels.
|
|
68
70
|
Use `references/db-supabase-safety-lite.md` when a command or prompt contains DB/Supabase mutation signals.
|
|
69
71
|
Use `references/token-economy.md` to keep context small.
|
|
70
72
|
Use `references/context-reuse.md` before broad project reading.
|
|
73
|
+
Use `references/study-note.md` when any code, config, docs, or project artifact changed; include role, execution point, before/after, expected behavior, one syntax/structure insight, verification, limits, and architecture hygiene when relevant.
|
|
71
74
|
Use `references/final-report.md` to close with remaining tasks and fix-first items when useful.
|
|
72
75
|
Use `references/token-budget-reporter.md` when a run needs measured budget feedback.
|
|
73
76
|
|
|
@@ -76,7 +79,8 @@ Use `references/token-budget-reporter.md` when a run needs measured budget feedb
|
|
|
76
79
|
Keep it compact:
|
|
77
80
|
|
|
78
81
|
- What changed or what the scan found.
|
|
79
|
-
- Study Note when
|
|
82
|
+
- Study Note when code, config, docs, or project artifacts changed: what changed, what role it has, where it runs or is read, what was wrong or missing, before/after behavior, what behavior is expected, one useful syntax/structure insight, what was verified, and what remains uncertain.
|
|
83
|
+
- Architecture hygiene when relevant: flag if the change risks dumping unrelated logic into `page.tsx`, one-off component CSS into `global.css`, or structured product data into broad DB `jsonb` blobs.
|
|
80
84
|
- What was checked.
|
|
81
85
|
- What was skipped, blocked, or still risky.
|
|
82
86
|
- Handoff when useful: fix-first items, remaining tasks, recommended direction, why that next step matters, blocker kind, safe retry, evidence level/stamp, and owner scope when another route or person may continue.
|
package/skills/ueye/SKILL.md
CHANGED
|
@@ -43,6 +43,7 @@ Do not use for:
|
|
|
43
43
|
- Prefer the in-app browser for interactive visual checks. Do not switch to a profile-dependent browser unless the user explicitly asks or the task requires existing cookies, sessions, extensions, or profile state.
|
|
44
44
|
- Ueye owns the design completion gate. Do not rely on a separate code-risk route to catch sloppy visual completion.
|
|
45
45
|
- Draft or needs-polish work may stay fast; a `done` claim requires recorded design gate evidence.
|
|
46
|
+
- Use the Verification Ladder: ordinary UI implementation can stay L1-L3, but a visual `done` claim needs L3-L4 evidence when feasible.
|
|
46
47
|
- Do not claim a Ueye result is done when implementation evidence, design quality, P0/P1 status, state coverage, mobile/responsive behavior, contrast/accessibility visuals, CTA affordance, or reference-read/comparison evidence is missing where relevant.
|
|
47
48
|
|
|
48
49
|
## Workflow
|
|
@@ -145,6 +146,8 @@ Use these artifacts for reference-led implementation or serious visual review. K
|
|
|
145
146
|
## Design Checks
|
|
146
147
|
|
|
147
148
|
Use `references/ueye.md` and `references/ui-quality.md`.
|
|
149
|
+
Use `references/verification-levels.md` for visual proof levels and done-claim truth caps.
|
|
150
|
+
Use `references/study-note.md` when UI code, design docs, config, or project artifacts changed; include role, execution point, before/after, expected behavior, one syntax/structure insight, verification, limits, and architecture hygiene when relevant.
|
|
148
151
|
Always consider:
|
|
149
152
|
|
|
150
153
|
- Direction fit.
|
|
@@ -170,6 +173,7 @@ Report:
|
|
|
170
173
|
- Review continuity/comparison result when this continues a prior Ueye run.
|
|
171
174
|
- P0-P3 issues or confirmation that no blockers were found.
|
|
172
175
|
- States/viewports checked.
|
|
173
|
-
- Study Note when UI
|
|
176
|
+
- Study Note when UI code, design docs, config, or project artifacts changed: what changed, what role it has, where it runs or is read, what was wrong or missing, before/after behavior, what behavior is expected, one useful syntax/structure insight, what was verified, and what remains uncertain.
|
|
177
|
+
- Architecture hygiene when relevant: flag if the change risks dumping unrelated UI logic into `page.tsx`, one-off component styling into `global.css`, or structured product data into broad DB `jsonb` blobs.
|
|
174
178
|
- Truth status and visual verification cap.
|
|
175
179
|
- Handoff when useful: fix-first visual issues, remaining tasks, recommended direction, why that next step matters, blocker kind, safe retry, evidence level/stamp, and owner scope when another route or person may continue.
|