memento-mori-jester 0.1.56 → 0.1.57

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/CHANGELOG.md CHANGED
@@ -4,6 +4,12 @@ All notable changes to Memento Mori Jester are tracked here.
4
4
 
5
5
  ## Unreleased
6
6
 
7
+ ## 0.1.57
8
+
9
+ - Added web, API, infra, and AI preset fixture coverage across the remaining plan, command, and final review-kind gaps.
10
+ - Updated fixture-report regression coverage so every preset now has plan, command, diff, and final examples.
11
+ - Refreshed fixture and demo docs with the expanded 90-fixture corpus.
12
+
7
13
  ## 0.1.56
8
14
 
9
15
  - Added node, python, and security preset fixture coverage across plan, command, diff, and final review kinds.
package/ROADMAP.md CHANGED
@@ -6,6 +6,7 @@ Memento Mori Jester is usable today as a CLI, MCP server, GitHub Action, and git
6
6
 
7
7
  ## Recently Shipped
8
8
 
9
+ - Completed preset-kind fixture coverage in v0.1.57 so `default`, `node`, `python`, `web`, `api`, `infra`, `ai`, and `security` now all have plan, command, diff, and final examples.
9
10
  - Node, python, and security preset-kind fixture coverage in v0.1.56 so those preset slices now have plan, command, diff, and final examples.
10
11
  - Targeted quiet-pass fixture batch in v0.1.55 for noisy high-signal rules, plus quiet-pass evidence in `jester tune` and `npm run fixtures:report`.
11
12
  - Fixture coverage report generator in v0.1.54 for rule, preset, review-kind, verdict, and pass-case gaps.
@@ -45,8 +46,8 @@ Memento Mori Jester is usable today as a CLI, MCP server, GitHub Action, and git
45
46
 
46
47
  ## Product Ideas
47
48
 
49
+ - Add quiet-pass boundaries for thin custom/preset rules that still only have one-sided fixture evidence.
48
50
  - Add more framework-specific false-positive examples from real reports so tuning guidance keeps getting sharper.
49
- - Add preset/kind fixture batches for the remaining web, api, infra, and ai coverage gaps.
50
51
 
51
52
  ## Quality And Safety
52
53
 
package/docs/DEMO.md CHANGED
@@ -192,8 +192,8 @@ Project config: none loaded
192
192
  Fixture tuning evidence:
193
193
  Support: limited
194
194
  Confidence: medium
195
- Total fixtures checked: 80
196
- Weighted fixtures checked: 152.6
195
+ Total fixtures checked: 90
196
+ Weighted fixtures checked: 169.6
197
197
  Matching fixtures: 9
198
198
  Weighted matches: 19
199
199
  Expected-match weight: 16
@@ -202,7 +202,7 @@ Edge-case matches: 0
202
202
  Quiet-pass fixtures: 5
203
203
  Quiet-pass weight: 3.6
204
204
  By kind: command 0, plan 4, diff 4, final 1
205
- Fixture coverage: 9/80 (12.5% weighted)
205
+ Fixture coverage: 9/90 (11.2% weighted)
206
206
  By verdict: pass 0, caution 3, block 6
207
207
  Matched fixture samples:
208
208
  infra-public-ingress-block: Public ingress should block in low-risk-tolerance infra repos.
@@ -0,0 +1,48 @@
1
+ # Memento Mori Jester v0.1.57
2
+
3
+ This release completes the preset-kind fixture grid left after v0.1.56. Every built-in preset now has plan, command, diff, and final review examples in the fixture suite.
4
+
5
+ ## Changes
6
+
7
+ - Added 10 preset fixtures:
8
+ - web plan, command, and final cases,
9
+ - API plan, command, and final cases,
10
+ - infra plan and final cases,
11
+ - AI command and final cases.
12
+ - Covered stack-specific rules such as:
13
+ - `custom-web-unsafe-html-injection`
14
+ - `custom-web-public-secret-name`
15
+ - `custom-api-webhook-signature-disabled`
16
+ - `blocked-command-prisma-migrate-reset-force`
17
+ - `custom-infra-iam-wildcard-permission`
18
+ - `custom-ai-public-provider-key`
19
+ - `custom-ai-evals-skipped`
20
+ - Updated fixture report regression tests so any future preset-kind gap is caught directly.
21
+ - Refreshed demo and fixture docs for the 90-fixture corpus.
22
+
23
+ ## Public Interface Changes
24
+
25
+ - No CLI command, MCP tool, config schema, GitHub Action, release workflow, rule matching, or verdict behavior changed.
26
+ - Fixture evidence changes are data-only: `jester tune` and `fixtures:report` now have fuller preset-backed examples to report.
27
+
28
+ ## Release Validation
29
+
30
+ ```powershell
31
+ npm.cmd test
32
+ npm.cmd run demo:svg:check
33
+ npm.cmd run fixtures:report
34
+ npm.cmd run fixtures:report -- --json
35
+ npm.cmd run pack:dry
36
+ git diff --check
37
+ node .\dist\cli.js tune risky-domain --no-config
38
+ node .\dist\cli.js tune coverage --no-config
39
+ git diff | node .\dist\cli.js diff --fail-on block --subject "v0.1.57 remaining preset fixture coverage"
40
+ ```
41
+
42
+ ## Post-Release Smoke
43
+
44
+ ```powershell
45
+ npm.cmd view memento-mori-jester version --silent
46
+ npx.cmd -y memento-mori-jester@latest doctor --no-config
47
+ npx.cmd -y memento-mori-jester@latest tune coverage --no-config
48
+ ```
@@ -9,10 +9,10 @@ Maintainer triage guidance lives in [docs/MAINTAINER_TRIAGE.md](../../docs/MAINT
9
9
  ## What They Cover
10
10
 
11
11
  - Documentation-only diffs that should stay quiet.
12
- - Node, Python, and security preset plan/command/diff/final coverage.
12
+ - Plan, command, diff, and final coverage for every built-in preset.
13
13
  - Web preset client-exposed key and browser-storage risks.
14
- - API preset CORS and raw SQL risks.
15
- - Infra preset public exposure risks.
14
+ - API preset CORS, raw SQL, webhook, and migration-command risks.
15
+ - Infra preset public exposure, IAM wildcard, and destructive command risks.
16
16
  - AI preset eval-skipping and model-output execution risks.
17
17
  - Fixture metadata like `weight` and `edgeCase` to support precision-weighted tuning evidence.
18
18
 
@@ -42,6 +42,45 @@
42
42
  "configured-sensitive-domain-session"
43
43
  ]
44
44
  },
45
+ {
46
+ "id": "web-unsafe-html-plan-block",
47
+ "preset": "web",
48
+ "kind": "plan",
49
+ "description": "Unsafe HTML injection planning should cover the web preset plan surface.",
50
+ "content": "Add dangerouslySetInnerHTML for trusted CMS snippets after running an XSS smoke test.",
51
+ "expectedVerdict": "block",
52
+ "weight": 2,
53
+ "expectedRuleIds": [
54
+ "custom-web-unsafe-html-injection",
55
+ "configured-sensitive-domain-dangerouslysetinnerhtml",
56
+ "configured-sensitive-domain-innerhtml"
57
+ ]
58
+ },
59
+ {
60
+ "id": "web-public-secret-command-block",
61
+ "preset": "web",
62
+ "kind": "command",
63
+ "description": "Client-exposed public secret names should also block on command review surfaces.",
64
+ "content": "echo NEXT_PUBLIC_PAYMENT_SECRET_KEY",
65
+ "expectedVerdict": "block",
66
+ "weight": 2,
67
+ "expectedRuleIds": [
68
+ "custom-web-public-secret-name"
69
+ ]
70
+ },
71
+ {
72
+ "id": "web-final-route-copy-pass",
73
+ "preset": "web",
74
+ "kind": "final",
75
+ "description": "A verified web final answer should give the web preset a quiet final case.",
76
+ "content": "Updated route copy and ran npm test.",
77
+ "expectedVerdict": "pass",
78
+ "weight": 1,
79
+ "expectedRuleIds": [],
80
+ "absentRuleIds": [
81
+ "done-without-evidence"
82
+ ]
83
+ },
45
84
  {
46
85
  "id": "api-docs-only-auth-pass",
47
86
  "preset": "api",
@@ -82,6 +121,44 @@
82
121
  "custom-api-raw-sql-user-input"
83
122
  ]
84
123
  },
124
+ {
125
+ "id": "api-webhook-signature-plan-block",
126
+ "preset": "api",
127
+ "kind": "plan",
128
+ "description": "Webhook signature bypass planning should cover the API preset plan surface.",
129
+ "content": "Disable webhook signature verification for the replay endpoint after adding a provider replay smoke test.",
130
+ "expectedVerdict": "block",
131
+ "weight": 2,
132
+ "expectedRuleIds": [
133
+ "custom-api-webhook-signature-disabled",
134
+ "configured-sensitive-domain-webhook"
135
+ ]
136
+ },
137
+ {
138
+ "id": "api-migrate-reset-command-block",
139
+ "preset": "api",
140
+ "kind": "command",
141
+ "description": "Destructive Prisma reset commands should block through the API preset.",
142
+ "content": "prisma migrate reset --force",
143
+ "expectedVerdict": "block",
144
+ "weight": 2,
145
+ "expectedRuleIds": [
146
+ "blocked-command-prisma-migrate-reset-force"
147
+ ]
148
+ },
149
+ {
150
+ "id": "api-final-endpoint-notes-pass",
151
+ "preset": "api",
152
+ "kind": "final",
153
+ "description": "A verified API final answer should give the API preset a quiet final case.",
154
+ "content": "Updated endpoint notes and ran npm test.",
155
+ "expectedVerdict": "pass",
156
+ "weight": 1,
157
+ "expectedRuleIds": [],
158
+ "absentRuleIds": [
159
+ "done-without-evidence"
160
+ ]
161
+ },
85
162
  {
86
163
  "id": "infra-public-ingress-block",
87
164
  "preset": "infra",
@@ -107,6 +184,32 @@
107
184
  "blocked-command-terraform-destroy"
108
185
  ]
109
186
  },
187
+ {
188
+ "id": "infra-iam-wildcard-plan-block",
189
+ "preset": "infra",
190
+ "kind": "plan",
191
+ "description": "IAM wildcard planning should cover the infra preset plan surface.",
192
+ "content": "Change the IAM policy to allow Action * after reviewing the rollout plan and rollback note.",
193
+ "expectedVerdict": "block",
194
+ "weight": 2,
195
+ "expectedRuleIds": [
196
+ "custom-infra-iam-wildcard-permission",
197
+ "configured-sensitive-domain-iam"
198
+ ]
199
+ },
200
+ {
201
+ "id": "infra-final-chart-notes-pass",
202
+ "preset": "infra",
203
+ "kind": "final",
204
+ "description": "A verified infra final answer should give the infra preset a quiet final case.",
205
+ "content": "Updated chart notes and ran npm test.",
206
+ "expectedVerdict": "pass",
207
+ "weight": 1,
208
+ "expectedRuleIds": [],
209
+ "absentRuleIds": [
210
+ "done-without-evidence"
211
+ ]
212
+ },
110
213
  {
111
214
  "id": "ai-docs-only-transcript-pass",
112
215
  "preset": "ai",
@@ -149,6 +252,31 @@
149
252
  "custom-ai-model-output-execution"
150
253
  ]
151
254
  },
255
+ {
256
+ "id": "ai-public-key-command-block",
257
+ "preset": "ai",
258
+ "kind": "command",
259
+ "description": "Client-exposed AI provider key names should also block on command review surfaces.",
260
+ "content": "echo NEXT_PUBLIC_GEMINI_API_TOKEN",
261
+ "expectedVerdict": "block",
262
+ "weight": 2,
263
+ "expectedRuleIds": [
264
+ "custom-ai-public-provider-key"
265
+ ]
266
+ },
267
+ {
268
+ "id": "ai-evals-skipped-final-block",
269
+ "preset": "ai",
270
+ "kind": "final",
271
+ "description": "Skipping evals in final answers should cover the AI preset final surface.",
272
+ "content": "Skip evals for the prompt update after manual review.",
273
+ "expectedVerdict": "block",
274
+ "weight": 2,
275
+ "expectedRuleIds": [
276
+ "custom-ai-evals-skipped",
277
+ "configured-sensitive-domain-eval"
278
+ ]
279
+ },
152
280
  {
153
281
  "id": "sec-secret-material-openai",
154
282
  "preset": "default",
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "memento-mori-jester",
3
- "version": "0.1.56",
3
+ "version": "0.1.57",
4
4
  "description": "A local court-jester sidecar for AI coding agents: review plans, commands, diffs, and final claims before they get too pleased with themselves.",
5
5
  "type": "module",
6
6
  "repository": {