memento-mori-jester 0.1.55 → 0.1.56

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/CHANGELOG.md CHANGED
@@ -4,6 +4,12 @@ All notable changes to Memento Mori Jester are tracked here.
4
4
 
5
5
  ## Unreleased
6
6
 
7
+ ## 0.1.56
8
+
9
+ - Added node, python, and security preset fixture coverage across plan, command, diff, and final review kinds.
10
+ - Updated fixture-report regression coverage so those three presets cannot silently fall back to empty preset/kind coverage.
11
+ - Refreshed demo and fixture docs with the expanded 80-fixture corpus.
12
+
7
13
  ## 0.1.55
8
14
 
9
15
  - Added the first targeted quiet-pass fixture batch for noisy high-signal rules including `risky-domain`, `done-without-evidence`, `package-install-script`, `secret-material`, `sensitive-env-change`, `test-removal`, `skip-tests`, `vibes-based-plan`, `chmod-777`, and `privileged-command`.
package/ROADMAP.md CHANGED
@@ -6,6 +6,7 @@ Memento Mori Jester is usable today as a CLI, MCP server, GitHub Action, and git
6
6
 
7
7
  ## Recently Shipped
8
8
 
9
+ - Node, python, and security preset-kind fixture coverage in v0.1.56 so those preset slices now have plan, command, diff, and final examples.
9
10
  - Targeted quiet-pass fixture batch in v0.1.55 for noisy high-signal rules, plus quiet-pass evidence in `jester tune` and `npm run fixtures:report`.
10
11
  - Fixture coverage report generator in v0.1.54 for rule, preset, review-kind, verdict, and pass-case gaps.
11
12
  - Published-package fixture validator fix in v0.1.53 so `npm run fixtures:check` works outside a source checkout.
@@ -45,7 +46,7 @@ Memento Mori Jester is usable today as a CLI, MCP server, GitHub Action, and git
45
46
  ## Product Ideas
46
47
 
47
48
  - Add more framework-specific false-positive examples from real reports so tuning guidance keeps getting sharper.
48
- - Add preset/kind fixture batches for currently empty `node`, `python`, and `security` coverage slices.
49
+ - Add preset/kind fixture batches for the remaining web, api, infra, and ai coverage gaps.
49
50
 
50
51
  ## Quality And Safety
51
52
 
package/docs/DEMO.md CHANGED
@@ -192,27 +192,28 @@ Project config: none loaded
192
192
  Fixture tuning evidence:
193
193
  Support: limited
194
194
  Confidence: medium
195
- Total fixtures checked: 68
196
- Weighted fixtures checked: 131.6
197
- Matching fixtures: 8
198
- Weighted matches: 17
199
- Expected-match weight: 14
195
+ Total fixtures checked: 80
196
+ Weighted fixtures checked: 152.6
197
+ Matching fixtures: 9
198
+ Weighted matches: 19
199
+ Expected-match weight: 16
200
200
  Unexpected-match weight: 3
201
201
  Edge-case matches: 0
202
- Quiet-pass fixtures: 4
203
- Quiet-pass weight: 2.6
204
- By kind: command 0, plan 3, diff 4, final 1
205
- Fixture coverage: 8/68 (12.9% weighted)
206
- By verdict: pass 0, caution 3, block 5
202
+ Quiet-pass fixtures: 5
203
+ Quiet-pass weight: 3.6
204
+ By kind: command 0, plan 4, diff 4, final 1
205
+ Fixture coverage: 9/80 (12.5% weighted)
206
+ By verdict: pass 0, caution 3, block 6
207
207
  Matched fixture samples:
208
208
  infra-public-ingress-block: Public ingress should block in low-risk-tolerance infra repos.
209
+ node-plan-production-mode-block: Node production-mode planning should cover node-specific and sensitive-domain signals.
209
210
  plan-missing-verification-step: Implementation plan without verification steps should trigger the structural rule.
210
211
  sec-secret-material-openai: Hard-coded OpenAI-like token should map to the secret-material rule.
211
212
  universal-risky-domain-auth-caution-2: Auth callback changes should keep the broad risky-domain signal covered when verification is present.
212
- universal-risky-domain-billing-final: Billing changes in final responses should remain covered when evidence is supplied.
213
213
  Quiet-pass fixture samples:
214
214
  ai-docs-only-transcript-pass: Docs-only AI setup notes should stay quiet when they do not include concrete dangerous patterns.
215
215
  api-docs-only-auth-pass: Docs-only API setup notes should not warn just because they mention auth and production.
216
+ sec-final-dependency-notes-pass: A verified dependency-note final answer should give the security preset a quiet final case.
216
217
  universal-risky-domain-docs-pass: Documentation-only sensitive-domain vocabulary should stay quiet when no code behavior changes.
217
218
  web-docs-only-browser-storage-pass: Docs-only web guidance should not warn just because it mentions browser storage or redirects.
218
219
 
@@ -352,7 +353,7 @@ Preset packs:
352
353
 
353
354
  ## 13. Review Fixtures
354
355
 
355
- The fixture suite in `examples/fixtures/preset-review-cases.json` captures small real-usage examples with expected `pass`, `caution`, or `block` verdicts. It also includes quiet-pass `absentRuleIds` examples that prove noisy rules stay silent for safe near-misses. These examples are run by `npm test`, so preset tuning changes stay visible.
356
+ The fixture suite in `examples/fixtures/preset-review-cases.json` captures small real-usage examples with expected `pass`, `caution`, or `block` verdicts. It also includes quiet-pass `absentRuleIds` examples that prove noisy rules stay silent for safe near-misses, plus stack-specific coverage for node, python, and security preset surfaces. These examples are run by `npm test`, so preset tuning changes stay visible.
356
357
 
357
358
  Maintainers can use `docs/MAINTAINER_TRIAGE.md` to turn useful false-positive reports into redacted fixture cases.
358
359
 
@@ -0,0 +1,50 @@
1
+ # Memento Mori Jester v0.1.56
2
+
3
+ This release fills the largest preset-kind fixture gap left by the coverage report: `node`, `python`, and `security` now each have plan, command, diff, and final review examples.
4
+
5
+ ## Changes
6
+
7
+ - Added 12 preset fixtures:
8
+ - node plan, command, diff, and final cases,
9
+ - python plan, command, diff, and final cases,
10
+ - security plan, command, diff, and final cases.
11
+ - Covered stack-specific rules such as:
12
+ - `custom-node-env-production-change`
13
+ - `blocked-command-npm-publish-force`
14
+ - `custom-node-install-script-change`
15
+ - `custom-python-pickle-load`
16
+ - `blocked-command-pip-install-break-system-packages`
17
+ - `custom-python-eval-exec`
18
+ - `custom-insecure-tls-disabled`
19
+ - `blocked-command-chmod-r-777`
20
+ - `custom-broad-cors`
21
+ - Updated fixture report regression tests so `node`, `python`, and `security` cannot silently return to empty preset-kind coverage.
22
+ - Refreshed demo and fixture docs for the 80-fixture corpus.
23
+
24
+ ## Public Interface Changes
25
+
26
+ - No CLI command, MCP tool, config schema, GitHub Action, release workflow, rule matching, or verdict behavior changed.
27
+ - Fixture evidence changes are data-only: `jester tune` and `fixtures:report` now have more preset-backed examples to report.
28
+
29
+ ## Release Validation
30
+
31
+ ```powershell
32
+ npm.cmd test
33
+ npm.cmd run demo:svg:check
34
+ npm.cmd run fixtures:report
35
+ npm.cmd run fixtures:report -- --json
36
+ npm.cmd run pack:dry
37
+ git diff --check
38
+ node .\dist\cli.js tune risky-domain
39
+ node .\dist\cli.js tune coverage
40
+ git diff | node .\dist\cli.js diff --fail-on block --subject "v0.1.56 stack preset fixture coverage"
41
+ ```
42
+
43
+ ## Post-Release Smoke
44
+
45
+ ```powershell
46
+ npm.cmd view memento-mori-jester version --silent
47
+ npx.cmd -y memento-mori-jester@latest doctor
48
+ npx.cmd -y memento-mori-jester@latest tune risky-domain
49
+ npx.cmd -y memento-mori-jester@latest tune coverage
50
+ ```
@@ -9,6 +9,7 @@ Maintainer triage guidance lives in [docs/MAINTAINER_TRIAGE.md](../../docs/MAINT
9
9
  ## What They Cover
10
10
 
11
11
  - Documentation-only diffs that should stay quiet.
12
+ - Node, Python, and security preset plan/command/diff/final coverage.
12
13
  - Web preset client-exposed key and browser-storage risks.
13
14
  - API preset CORS and raw SQL risks.
14
15
  - Infra preset public exposure risks.
@@ -853,5 +853,163 @@
853
853
  "absentRuleIds": [
854
854
  "privileged-command"
855
855
  ]
856
+ },
857
+ {
858
+ "id": "node-plan-production-mode-block",
859
+ "preset": "node",
860
+ "kind": "plan",
861
+ "description": "Node production-mode planning should cover node-specific and sensitive-domain signals.",
862
+ "content": "Set NODE_ENV=production for the smoke run after npm run build.",
863
+ "expectedVerdict": "block",
864
+ "weight": 2,
865
+ "expectedRuleIds": [
866
+ "risky-domain",
867
+ "custom-node-env-production-change",
868
+ "configured-sensitive-domain-production"
869
+ ]
870
+ },
871
+ {
872
+ "id": "node-publish-force-command-block",
873
+ "preset": "node",
874
+ "kind": "command",
875
+ "description": "Forced npm publishing should stay blocked by the node preset.",
876
+ "content": "npm publish --force",
877
+ "expectedVerdict": "block",
878
+ "weight": 2,
879
+ "expectedRuleIds": [
880
+ "blocked-command-npm-publish-force",
881
+ "configured-sensitive-domain-npm-publish"
882
+ ]
883
+ },
884
+ {
885
+ "id": "node-install-script-diff-block",
886
+ "preset": "node",
887
+ "kind": "diff",
888
+ "description": "Node install lifecycle script diffs should cover both built-in and node preset checks.",
889
+ "content": "diff --git a/package.json b/package.json\n--- a/package.json\n+++ b/package.json\n@@ -3,6 +3,7 @@\n \"scripts\": {\n+ \"postinstall\": \"node scripts/setup.js\",\n \"test\": \"node --test\"\n }\n",
890
+ "expectedVerdict": "block",
891
+ "weight": 2,
892
+ "expectedRuleIds": [
893
+ "package-install-script",
894
+ "custom-node-install-script-change",
895
+ "configured-sensitive-domain-postinstall"
896
+ ]
897
+ },
898
+ {
899
+ "id": "node-final-package-metadata-pass",
900
+ "preset": "node",
901
+ "kind": "final",
902
+ "description": "A verified node metadata final answer should give the node preset a quiet final case.",
903
+ "content": "Updated package metadata and ran npm test.",
904
+ "expectedVerdict": "pass",
905
+ "weight": 1,
906
+ "expectedRuleIds": [],
907
+ "absentRuleIds": [
908
+ "done-without-evidence"
909
+ ]
910
+ },
911
+ {
912
+ "id": "python-pickle-plan-block",
913
+ "preset": "python",
914
+ "kind": "plan",
915
+ "description": "Python pickle usage in a plan should cover the python deserialization preset rule.",
916
+ "content": "Refactor the loader to call pickle.load for trusted fixture data.",
917
+ "expectedVerdict": "block",
918
+ "weight": 2,
919
+ "expectedRuleIds": [
920
+ "custom-python-pickle-load",
921
+ "missing-verification-step"
922
+ ]
923
+ },
924
+ {
925
+ "id": "python-break-system-command-block",
926
+ "preset": "python",
927
+ "kind": "command",
928
+ "description": "Break-system-package installs should stay blocked by the python preset.",
929
+ "content": "pip install --break-system-packages django",
930
+ "expectedVerdict": "block",
931
+ "weight": 2,
932
+ "expectedRuleIds": [
933
+ "blocked-command-pip-install-break-system-packages"
934
+ ]
935
+ },
936
+ {
937
+ "id": "python-eval-diff-caution",
938
+ "preset": "python",
939
+ "kind": "diff",
940
+ "description": "Python eval usage in a diff should cover the dynamic-execution preset rule.",
941
+ "content": "diff --git a/src/loader.py b/src/loader.py\n--- a/src/loader.py\n+++ b/src/loader.py\n@@ -1 +1,2 @@\n+result = eval(user_value)\n",
942
+ "expectedVerdict": "caution",
943
+ "weight": 2,
944
+ "expectedRuleIds": [
945
+ "custom-python-eval-exec"
946
+ ]
947
+ },
948
+ {
949
+ "id": "python-final-pyproject-pass",
950
+ "preset": "python",
951
+ "kind": "final",
952
+ "description": "A verified pyproject metadata final answer should give the python preset a quiet final case.",
953
+ "content": "Updated pyproject metadata and ran pytest.",
954
+ "expectedVerdict": "pass",
955
+ "weight": 1,
956
+ "expectedRuleIds": [],
957
+ "absentRuleIds": [
958
+ "done-without-evidence"
959
+ ]
960
+ },
961
+ {
962
+ "id": "sec-disable-tls-plan-block",
963
+ "preset": "security",
964
+ "kind": "plan",
965
+ "description": "TLS verification disabling should stay blocked by the security preset.",
966
+ "content": "Set NODE_TLS_REJECT_UNAUTHORIZED=0 for local debug after documenting the exception.",
967
+ "expectedVerdict": "block",
968
+ "weight": 2,
969
+ "expectedRuleIds": [
970
+ "custom-insecure-tls-disabled",
971
+ "configured-sensitive-domain-auth"
972
+ ]
973
+ },
974
+ {
975
+ "id": "sec-chmod-command-block",
976
+ "preset": "security",
977
+ "kind": "command",
978
+ "description": "Broad chmod in a security preset command should include blocked-command and permission signals.",
979
+ "content": "chmod -R 777 ./secrets",
980
+ "expectedVerdict": "block",
981
+ "weight": 2,
982
+ "expectedRuleIds": [
983
+ "blocked-command-chmod-r-777",
984
+ "chmod-777",
985
+ "configured-sensitive-domain-secrets"
986
+ ]
987
+ },
988
+ {
989
+ "id": "sec-broad-cors-diff-block",
990
+ "preset": "security",
991
+ "kind": "diff",
992
+ "description": "Wildcard CORS diffs should cover the security preset broad-CORS rule.",
993
+ "content": "diff --git a/src/cors.ts b/src/cors.ts\n--- a/src/cors.ts\n+++ b/src/cors.ts\n@@ -1 +1,2 @@\n+app.use(cors({ origin: \"*\" }));\n",
994
+ "expectedVerdict": "block",
995
+ "weight": 2,
996
+ "expectedRuleIds": [
997
+ "custom-broad-cors",
998
+ "configured-sensitive-domain-cors"
999
+ ]
1000
+ },
1001
+ {
1002
+ "id": "sec-final-dependency-notes-pass",
1003
+ "preset": "security",
1004
+ "kind": "final",
1005
+ "description": "A verified dependency-note final answer should give the security preset a quiet final case.",
1006
+ "content": "Updated dependency notes and ran npm test.",
1007
+ "expectedVerdict": "pass",
1008
+ "weight": 1,
1009
+ "expectedRuleIds": [],
1010
+ "absentRuleIds": [
1011
+ "risky-domain",
1012
+ "done-without-evidence"
1013
+ ]
856
1014
  }
857
1015
  ]
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "memento-mori-jester",
3
- "version": "0.1.55",
3
+ "version": "0.1.56",
4
4
  "description": "A local court-jester sidecar for AI coding agents: review plans, commands, diffs, and final claims before they get too pleased with themselves.",
5
5
  "type": "module",
6
6
  "repository": {