@riddledc/riddle-proof 0.8.68 → 0.8.69
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
|
@@ -4,6 +4,11 @@
|
|
|
4
4
|
It is meant to keep broad user-story sweeps evidence-backed and reviewable
|
|
5
5
|
without turning them into unbounded scaffolding.
|
|
6
6
|
|
|
7
|
+
`riddle-proof-ux-coverage.csv` is the spreadsheet view of the same loop. Open it
|
|
8
|
+
in a spreadsheet editor when you want the "status bar" view: surface, user story,
|
|
9
|
+
expected behavior, runner, required evidence, last result, finding, next action,
|
|
10
|
+
and priority.
|
|
11
|
+
|
|
7
12
|
Each story names:
|
|
8
13
|
|
|
9
14
|
- the Riddle Proof surface under test
|
|
@@ -15,3 +20,11 @@ Each story names:
|
|
|
15
20
|
|
|
16
21
|
Use one batch at a time, save outputs under `artifacts/riddle-proof/<story-id>/`,
|
|
17
22
|
fix only high-signal failures, and rerun the same batch before expanding scope.
|
|
23
|
+
|
|
24
|
+
Use the CSV to choose the next batch:
|
|
25
|
+
|
|
26
|
+
- `passed`, `product_regression_expected`, and `found_fixed` rows need receipts
|
|
27
|
+
in `artifact_or_pr`.
|
|
28
|
+
- `ready_to_run` rows are good next targets for live dogfood passes.
|
|
29
|
+
- `needs_product_hook` rows point to product surfaces that need an import, shared
|
|
30
|
+
contract, or manual proof-view smoke before they can become recurring.
|
|
@@ -0,0 +1,17 @@
|
|
|
1
|
+
area,user_story_id,user_story,expected_behavior,surface,runner,evidence_required,last_result,last_run,artifact_or_pr,finding,next_action,priority,failure_class
|
|
2
|
+
"Authoring","rp-story-profile-suggest-drafts-not-verdicts","As a proof author, I can ask for suggested checks without accidentally treating the suggestion as proof.","Output is a draft profile only; it contains no passed, product_regression, or proof_insufficient verdict.","profile-suggest","local-cli","Generated profile; absence of proof verdict; saved stdout or draft path","passed","2026-06-21","docs/riddle-proof-story-matrix-runs/2026-06-21-initial-batch.md","Authoring boundary held: suggestions stayed drafts.","Promote after one more route-specific use against a real product change.","P2","doc_or_ux_gap"
|
|
3
|
+
"Local core","rp-story-local-core-trust-boundary","As a framework maintainer, I can validate core trust-boundary behavior without hosted infrastructure.","Local core regression pack passes route, query/hash, thrown-error, missing-selector, and no-diff cases.","regression-pack local core","local-core","regression-pack-result.json; required cases present; forbidden terminal markers absent","passed","2026-06-21","docs/riddle-proof-story-matrix-runs/2026-06-21-initial-batch.md","Core contracts are covered by a repeatable local suite.","Keep recurring and run before hosted batches.","P1","contract_gap"
|
|
4
|
+
"Hosted run","rp-story-hosted-happy-path-produces-artifacts","As a maintainer, I can run a hosted profile against a live route and receive evidence-backed artifacts.","Hosted run-profile returns passed and writes profile-result, summary, proof JSON, console, DOM summary, and screenshots.","run-profile hosted runner","hosted-riddle","profile-result.json; proof.json; screenshot; riddle.job_id","passed","2026-06-21","job_366d440b","Hosted happy path passed with 5/5 checks and artifact links.","Keep recurring; reuse as known-good packet for reporting and recovery checks.","P1","product_regression"
|
|
5
|
+
"Hosted negative control","rp-story-hosted-negative-control-stays-regression","As a maintainer, I can run a deliberate missing-selector profile and see product_regression instead of a false pass.","Negative control returns product_regression with failed-check evidence and artifacts.","run-profile hosted runner","hosted-riddle","profile-result.json; failed check; summary.md; console.json","product_regression_expected","2026-06-21","job_9f446230","Negative control stayed red: 1 passed / 1 failed.","Keep recurring next to hosted happy path.","P1","contract_gap"
|
|
6
|
+
"Cold start","rp-story-cold-start-does-not-duplicate-too-soon","As a hosted runner user, I can submit work while workers are scaled to zero without the client declaring the job stale too early.","Client waits through accepted worker cold-start latency and reports worker-wake progress.","hosted worker cold start","hosted-riddle","progress output; profile-result.json; queue/pre-submission timing","passed","2026-06-21","job_366d440b","Cold start waited about 165 seconds and completed without duplicate retry.","Run occasionally after infra changes; do not wait an hour for every batch.","P2","environment_blocked"
|
|
7
|
+
"Reporting","rp-story-pr-comment-renders-only-evidence-backed-status","As a reviewer, I can get a PR comment whose status, checks, screenshot, and links reflect the saved proof packet.","PR comment reads profile-result.json, uses profile check statuses, and links hosted artifacts.","pr-comment","local-cli","pr-comment-body.md; profile-result.json; screenshot/artifact links","found_fixed","2026-06-21","PR #947","Found real bug: profile packets were rejected or miscounted as 4 passed / 12 failed.","Keep recurring; replay against happy-path and negative-control packets.","P0","contract_gap"
|
|
8
|
+
"Artifact promotion","rp-story-profile-body-assertions-derive-from-real-artifact","As a profile promoter, I can derive body assertions from a real artifact before making a public claim.","Body assertion command emits present fragments and exits nonzero for missing required fragments.","profile-body-assertions","local-cli","body assertion output; nonzero missing-required case","passed","2026-06-21","docs/riddle-proof-story-matrix-runs/2026-06-21-initial-batch.md","Positive and missing-required cases behaved as a real gate.","Use when promoting public proof/profile claims.","P2","proof_insufficient"
|
|
9
|
+
"Artifact publication","rp-story-http-preflight-catches-publication-mismatch","As a publisher, I can preflight public artifact URLs before spending hosted browser time.","Preflight checks status, content type, bytes, required body fragments, forbidden body text, and JSON assertions.","profile-http-status-preflight","local-cli","preflight JSON; failed missing-fragment negative control","passed","2026-06-21","https://cdn.riddledc.com/scripts/job_366d440b/proof.json.json","Live CDN artifact passed positive checks; missing fragment failed clearly.","Keep as the cheap gate before broad hosted runs.","P1","product_regression"
|
|
10
|
+
"Recovery","rp-story-run-profile-recover-preserves-artifacts","As a user whose local process was interrupted, I can recover a hosted job and still get the proof artifacts and summary.","Recover preserves the original job id and writes profile-result, summary, proof JSON, console, DOM summary, and screenshot references.","run-profile recover","hosted-riddle","recovered profile-result.json; summary.md; proof.json; preserved job id","passed","2026-06-21","job_366d440b","Recovery reconstructed the hosted happy-path packet from the old job id.","Keep as recurring for interrupted-run confidence.","P2","environment_blocked"
|
|
11
|
+
"Package install","rp-ux-published-bin-resolves","As a new user, I can invoke the published package binary from a clean temporary directory.","npm exec resolves riddle-proof-loop and prints CLI help when npm is on PATH.","published package bin","npm-exec","npm exec output; package version","passed","2026-06-21","@riddledc/riddle-proof@0.8.68","Earlier command-not-found was local PATH, not a package bin defect.","Repeat after package metadata or bin changes.","P2","configuration_error"
|
|
12
|
+
"Local browser","rp-ux-local-playwright-runner-smoke","As a user avoiding hosted infra, I can run the local Playwright runner and receive the same profile-result contract shape.","riddle-proof-playwright writes profile-result.json, proof.json, console.json, dom-summary.json, summary.md, and artifact-manifest.json.","@riddledc/riddle-proof-runner-playwright","local-playwright","profile-result.json; artifact-manifest.json; screenshot or DOM evidence","passed","2026-06-21","docs/riddle-proof-story-matrix-runs/2026-06-21-ux-coverage-batch.md","Live local Playwright smoke passed against riddledc.com/proof with 5/5 checks.","Keep as local-vs-hosted parity smoke; rerun after runner package changes.","P1","configuration_error"
|
|
13
|
+
"Viewport matrices","rp-story-viewport-aggregate-does-not-hide-child-failure","As a maintainer running viewport matrices, I can aggregate child runs without losing the failing viewport.","Aggregate returns the worst child verdict, lists child outputs, and separates summed poll time from max child latency.","run-profile aggregate","local-cli","child profile-result files; aggregate profile-result.json; summary.md","product_regression_expected","2026-06-21","docs/riddle-proof-story-matrix-runs/2026-06-21-ux-coverage-batch.md","Aggregate preserved the phone child product_regression via split_viewport_children.","Keep as a recurring negative-control aggregate using one passing child and one failing child.","P1","contract_gap"
|
|
14
|
+
"Formal contract","rp-story-formal-kernel-matches-runtime-contract","As a framework maintainer, I can prove the status/result contract that runtime tests depend on.","Lean kernel builds and runtime conformance tests mirror the formal contract cases.","formal/riddle-proof-kernel","lean-kernel","lake build; formal-conformance test log","passed","2026-06-21","PR #947 CI formal-kernel","Formal layer stayed in contract-hardening path, not runtime evidence collection.","Keep recurring when status semantics change.","P2","contract_gap"
|
|
15
|
+
"Hosted proof view","rp-story-hosted-proof-view-uses-contract","As a hosted proof viewer, I see contract-derived status, artifacts, and missing-evidence explanations rather than raw backend fields.","Hosted proof renderer uses the same consumer-surface contract as PR comments and summaries.","hosted proof renderer","manual-review","manual review note; screenshot; passed and negative-control packets","needs_product_hook","","","Still not proven end-to-end through the hosted proof view UI.","Inspect renderer imports and run passed plus negative-control view smoke.","P1","contract_gap"
|
|
16
|
+
"Agent summary","rp-ux-agent-summary-uses-contract","As an agent consuming Riddle Proof output, I see the same evidence-backed status language as reviewers.","Agent-facing summaries use shared public-state/consumer-surface contract and avoid raw-field overclaiming.","agent-facing summary","manual-review","summary text; contract import or documented gap; negative-control packet","needs_product_hook","","","Still not proven outside PR comments.","Find agent summary renderer and wire or verify shared contract usage.","P1","contract_gap"
|
|
17
|
+
"Release and publish","rp-ux-release-publish-flow","As a package maintainer, I can merge a fix, get a version PR, and publish the package without manual status fakery.","Changeset release PR validates, merges, and trusted npm publish updates latest.","changesets release","github-actions","release PR; Release workflow; npm view latest","passed","2026-06-21","@riddledc/riddle-proof@0.8.68","Release path worked for the reporting fix and published with provenance.","Keep GitHub Action noise low and use this as release smoke.","P2","environment_blocked"
|