memento-mori-jester 0.1.55 → 0.1.56
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +6 -0
- package/ROADMAP.md +2 -1
- package/docs/DEMO.md +13 -12
- package/docs/RELEASE_NOTES_v0.1.56.md +50 -0
- package/examples/fixtures/README.md +1 -0
- package/examples/fixtures/preset-review-cases.json +158 -0
- package/package.json +1 -1
package/CHANGELOG.md
CHANGED
|
@@ -4,6 +4,12 @@ All notable changes to Memento Mori Jester are tracked here.
|
|
|
4
4
|
|
|
5
5
|
## Unreleased
|
|
6
6
|
|
|
7
|
+
## 0.1.56
|
|
8
|
+
|
|
9
|
+
- Added node, python, and security preset fixture coverage across plan, command, diff, and final review kinds.
|
|
10
|
+
- Updated fixture-report regression coverage so those three presets cannot silently fall back to empty preset/kind coverage.
|
|
11
|
+
- Refreshed demo and fixture docs with the expanded 80-fixture corpus.
|
|
12
|
+
|
|
7
13
|
## 0.1.55
|
|
8
14
|
|
|
9
15
|
- Added the first targeted quiet-pass fixture batch for noisy high-signal rules including `risky-domain`, `done-without-evidence`, `package-install-script`, `secret-material`, `sensitive-env-change`, `test-removal`, `skip-tests`, `vibes-based-plan`, `chmod-777`, and `privileged-command`.
|
package/ROADMAP.md
CHANGED
|
@@ -6,6 +6,7 @@ Memento Mori Jester is usable today as a CLI, MCP server, GitHub Action, and git
|
|
|
6
6
|
|
|
7
7
|
## Recently Shipped
|
|
8
8
|
|
|
9
|
+
- Node, python, and security preset-kind fixture coverage in v0.1.56 so those preset slices now have plan, command, diff, and final examples.
|
|
9
10
|
- Targeted quiet-pass fixture batch in v0.1.55 for noisy high-signal rules, plus quiet-pass evidence in `jester tune` and `npm run fixtures:report`.
|
|
10
11
|
- Fixture coverage report generator in v0.1.54 for rule, preset, review-kind, verdict, and pass-case gaps.
|
|
11
12
|
- Published-package fixture validator fix in v0.1.53 so `npm run fixtures:check` works outside a source checkout.
|
|
@@ -45,7 +46,7 @@ Memento Mori Jester is usable today as a CLI, MCP server, GitHub Action, and git
|
|
|
45
46
|
## Product Ideas
|
|
46
47
|
|
|
47
48
|
- Add more framework-specific false-positive examples from real reports so tuning guidance keeps getting sharper.
|
|
48
|
-
- Add preset/kind fixture batches for
|
|
49
|
+
- Add preset/kind fixture batches for the remaining web, api, infra, and ai coverage gaps.
|
|
49
50
|
|
|
50
51
|
## Quality And Safety
|
|
51
52
|
|
package/docs/DEMO.md
CHANGED
|
@@ -192,27 +192,28 @@ Project config: none loaded
|
|
|
192
192
|
Fixture tuning evidence:
|
|
193
193
|
Support: limited
|
|
194
194
|
Confidence: medium
|
|
195
|
-
Total fixtures checked:
|
|
196
|
-
Weighted fixtures checked:
|
|
197
|
-
Matching fixtures:
|
|
198
|
-
Weighted matches:
|
|
199
|
-
Expected-match weight:
|
|
195
|
+
Total fixtures checked: 80
|
|
196
|
+
Weighted fixtures checked: 152.6
|
|
197
|
+
Matching fixtures: 9
|
|
198
|
+
Weighted matches: 19
|
|
199
|
+
Expected-match weight: 16
|
|
200
200
|
Unexpected-match weight: 3
|
|
201
201
|
Edge-case matches: 0
|
|
202
|
-
Quiet-pass fixtures:
|
|
203
|
-
Quiet-pass weight:
|
|
204
|
-
By kind: command 0, plan
|
|
205
|
-
Fixture coverage:
|
|
206
|
-
By verdict: pass 0, caution 3, block
|
|
202
|
+
Quiet-pass fixtures: 5
|
|
203
|
+
Quiet-pass weight: 3.6
|
|
204
|
+
By kind: command 0, plan 4, diff 4, final 1
|
|
205
|
+
Fixture coverage: 9/80 (12.5% weighted)
|
|
206
|
+
By verdict: pass 0, caution 3, block 6
|
|
207
207
|
Matched fixture samples:
|
|
208
208
|
infra-public-ingress-block: Public ingress should block in low-risk-tolerance infra repos.
|
|
209
|
+
node-plan-production-mode-block: Node production-mode planning should cover node-specific and sensitive-domain signals.
|
|
209
210
|
plan-missing-verification-step: Implementation plan without verification steps should trigger the structural rule.
|
|
210
211
|
sec-secret-material-openai: Hard-coded OpenAI-like token should map to the secret-material rule.
|
|
211
212
|
universal-risky-domain-auth-caution-2: Auth callback changes should keep the broad risky-domain signal covered when verification is present.
|
|
212
|
-
universal-risky-domain-billing-final: Billing changes in final responses should remain covered when evidence is supplied.
|
|
213
213
|
Quiet-pass fixture samples:
|
|
214
214
|
ai-docs-only-transcript-pass: Docs-only AI setup notes should stay quiet when they do not include concrete dangerous patterns.
|
|
215
215
|
api-docs-only-auth-pass: Docs-only API setup notes should not warn just because they mention auth and production.
|
|
216
|
+
sec-final-dependency-notes-pass: A verified dependency-note final answer should give the security preset a quiet final case.
|
|
216
217
|
universal-risky-domain-docs-pass: Documentation-only sensitive-domain vocabulary should stay quiet when no code behavior changes.
|
|
217
218
|
web-docs-only-browser-storage-pass: Docs-only web guidance should not warn just because it mentions browser storage or redirects.
|
|
218
219
|
|
|
@@ -352,7 +353,7 @@ Preset packs:
|
|
|
352
353
|
|
|
353
354
|
## 13. Review Fixtures
|
|
354
355
|
|
|
355
|
-
The fixture suite in `examples/fixtures/preset-review-cases.json` captures small real-usage examples with expected `pass`, `caution`, or `block` verdicts. It also includes quiet-pass `absentRuleIds` examples that prove noisy rules stay silent for safe near-misses. These examples are run by `npm test`, so preset tuning changes stay visible.
|
|
356
|
+
The fixture suite in `examples/fixtures/preset-review-cases.json` captures small real-usage examples with expected `pass`, `caution`, or `block` verdicts. It also includes quiet-pass `absentRuleIds` examples that prove noisy rules stay silent for safe near-misses, plus stack-specific coverage for node, python, and security preset surfaces. These examples are run by `npm test`, so preset tuning changes stay visible.
|
|
356
357
|
|
|
357
358
|
Maintainers can use `docs/MAINTAINER_TRIAGE.md` to turn useful false-positive reports into redacted fixture cases.
|
|
358
359
|
|
|
@@ -0,0 +1,50 @@
|
|
|
1
|
+
# Memento Mori Jester v0.1.56
|
|
2
|
+
|
|
3
|
+
This release fills the largest preset-kind fixture gap left by the coverage report: `node`, `python`, and `security` now each have plan, command, diff, and final review examples.
|
|
4
|
+
|
|
5
|
+
## Changes
|
|
6
|
+
|
|
7
|
+
- Added 12 preset fixtures:
|
|
8
|
+
- node plan, command, diff, and final cases,
|
|
9
|
+
- python plan, command, diff, and final cases,
|
|
10
|
+
- security plan, command, diff, and final cases.
|
|
11
|
+
- Covered stack-specific rules such as:
|
|
12
|
+
- `custom-node-env-production-change`
|
|
13
|
+
- `blocked-command-npm-publish-force`
|
|
14
|
+
- `custom-node-install-script-change`
|
|
15
|
+
- `custom-python-pickle-load`
|
|
16
|
+
- `blocked-command-pip-install-break-system-packages`
|
|
17
|
+
- `custom-python-eval-exec`
|
|
18
|
+
- `custom-insecure-tls-disabled`
|
|
19
|
+
- `blocked-command-chmod-r-777`
|
|
20
|
+
- `custom-broad-cors`
|
|
21
|
+
- Updated fixture report regression tests so `node`, `python`, and `security` cannot silently return to empty preset-kind coverage.
|
|
22
|
+
- Refreshed demo and fixture docs for the 80-fixture corpus.
|
|
23
|
+
|
|
24
|
+
## Public Interface Changes
|
|
25
|
+
|
|
26
|
+
- No CLI command, MCP tool, config schema, GitHub Action, release workflow, rule matching, or verdict behavior changed.
|
|
27
|
+
- Fixture evidence changes are data-only: `jester tune` and `fixtures:report` now have more preset-backed examples to report.
|
|
28
|
+
|
|
29
|
+
## Release Validation
|
|
30
|
+
|
|
31
|
+
```powershell
|
|
32
|
+
npm.cmd test
|
|
33
|
+
npm.cmd run demo:svg:check
|
|
34
|
+
npm.cmd run fixtures:report
|
|
35
|
+
npm.cmd run fixtures:report -- --json
|
|
36
|
+
npm.cmd run pack:dry
|
|
37
|
+
git diff --check
|
|
38
|
+
node .\dist\cli.js tune risky-domain
|
|
39
|
+
node .\dist\cli.js tune coverage
|
|
40
|
+
git diff | node .\dist\cli.js diff --fail-on block --subject "v0.1.56 stack preset fixture coverage"
|
|
41
|
+
```
|
|
42
|
+
|
|
43
|
+
## Post-Release Smoke
|
|
44
|
+
|
|
45
|
+
```powershell
|
|
46
|
+
npm.cmd view memento-mori-jester version --silent
|
|
47
|
+
npx.cmd -y memento-mori-jester@latest doctor
|
|
48
|
+
npx.cmd -y memento-mori-jester@latest tune risky-domain
|
|
49
|
+
npx.cmd -y memento-mori-jester@latest tune coverage
|
|
50
|
+
```
|
|
@@ -9,6 +9,7 @@ Maintainer triage guidance lives in [docs/MAINTAINER_TRIAGE.md](../../docs/MAINT
|
|
|
9
9
|
## What They Cover
|
|
10
10
|
|
|
11
11
|
- Documentation-only diffs that should stay quiet.
|
|
12
|
+
- Node, Python, and security preset plan/command/diff/final coverage.
|
|
12
13
|
- Web preset client-exposed key and browser-storage risks.
|
|
13
14
|
- API preset CORS and raw SQL risks.
|
|
14
15
|
- Infra preset public exposure risks.
|
|
@@ -853,5 +853,163 @@
|
|
|
853
853
|
"absentRuleIds": [
|
|
854
854
|
"privileged-command"
|
|
855
855
|
]
|
|
856
|
+
},
|
|
857
|
+
{
|
|
858
|
+
"id": "node-plan-production-mode-block",
|
|
859
|
+
"preset": "node",
|
|
860
|
+
"kind": "plan",
|
|
861
|
+
"description": "Node production-mode planning should cover node-specific and sensitive-domain signals.",
|
|
862
|
+
"content": "Set NODE_ENV=production for the smoke run after npm run build.",
|
|
863
|
+
"expectedVerdict": "block",
|
|
864
|
+
"weight": 2,
|
|
865
|
+
"expectedRuleIds": [
|
|
866
|
+
"risky-domain",
|
|
867
|
+
"custom-node-env-production-change",
|
|
868
|
+
"configured-sensitive-domain-production"
|
|
869
|
+
]
|
|
870
|
+
},
|
|
871
|
+
{
|
|
872
|
+
"id": "node-publish-force-command-block",
|
|
873
|
+
"preset": "node",
|
|
874
|
+
"kind": "command",
|
|
875
|
+
"description": "Forced npm publishing should stay blocked by the node preset.",
|
|
876
|
+
"content": "npm publish --force",
|
|
877
|
+
"expectedVerdict": "block",
|
|
878
|
+
"weight": 2,
|
|
879
|
+
"expectedRuleIds": [
|
|
880
|
+
"blocked-command-npm-publish-force",
|
|
881
|
+
"configured-sensitive-domain-npm-publish"
|
|
882
|
+
]
|
|
883
|
+
},
|
|
884
|
+
{
|
|
885
|
+
"id": "node-install-script-diff-block",
|
|
886
|
+
"preset": "node",
|
|
887
|
+
"kind": "diff",
|
|
888
|
+
"description": "Node install lifecycle script diffs should cover both built-in and node preset checks.",
|
|
889
|
+
"content": "diff --git a/package.json b/package.json\n--- a/package.json\n+++ b/package.json\n@@ -3,6 +3,7 @@\n \"scripts\": {\n+ \"postinstall\": \"node scripts/setup.js\",\n \"test\": \"node --test\"\n }\n",
|
|
890
|
+
"expectedVerdict": "block",
|
|
891
|
+
"weight": 2,
|
|
892
|
+
"expectedRuleIds": [
|
|
893
|
+
"package-install-script",
|
|
894
|
+
"custom-node-install-script-change",
|
|
895
|
+
"configured-sensitive-domain-postinstall"
|
|
896
|
+
]
|
|
897
|
+
},
|
|
898
|
+
{
|
|
899
|
+
"id": "node-final-package-metadata-pass",
|
|
900
|
+
"preset": "node",
|
|
901
|
+
"kind": "final",
|
|
902
|
+
"description": "A verified node metadata final answer should give the node preset a quiet final case.",
|
|
903
|
+
"content": "Updated package metadata and ran npm test.",
|
|
904
|
+
"expectedVerdict": "pass",
|
|
905
|
+
"weight": 1,
|
|
906
|
+
"expectedRuleIds": [],
|
|
907
|
+
"absentRuleIds": [
|
|
908
|
+
"done-without-evidence"
|
|
909
|
+
]
|
|
910
|
+
},
|
|
911
|
+
{
|
|
912
|
+
"id": "python-pickle-plan-block",
|
|
913
|
+
"preset": "python",
|
|
914
|
+
"kind": "plan",
|
|
915
|
+
"description": "Python pickle usage in a plan should cover the python deserialization preset rule.",
|
|
916
|
+
"content": "Refactor the loader to call pickle.load for trusted fixture data.",
|
|
917
|
+
"expectedVerdict": "block",
|
|
918
|
+
"weight": 2,
|
|
919
|
+
"expectedRuleIds": [
|
|
920
|
+
"custom-python-pickle-load",
|
|
921
|
+
"missing-verification-step"
|
|
922
|
+
]
|
|
923
|
+
},
|
|
924
|
+
{
|
|
925
|
+
"id": "python-break-system-command-block",
|
|
926
|
+
"preset": "python",
|
|
927
|
+
"kind": "command",
|
|
928
|
+
"description": "Break-system-package installs should stay blocked by the python preset.",
|
|
929
|
+
"content": "pip install --break-system-packages django",
|
|
930
|
+
"expectedVerdict": "block",
|
|
931
|
+
"weight": 2,
|
|
932
|
+
"expectedRuleIds": [
|
|
933
|
+
"blocked-command-pip-install-break-system-packages"
|
|
934
|
+
]
|
|
935
|
+
},
|
|
936
|
+
{
|
|
937
|
+
"id": "python-eval-diff-caution",
|
|
938
|
+
"preset": "python",
|
|
939
|
+
"kind": "diff",
|
|
940
|
+
"description": "Python eval usage in a diff should cover the dynamic-execution preset rule.",
|
|
941
|
+
"content": "diff --git a/src/loader.py b/src/loader.py\n--- a/src/loader.py\n+++ b/src/loader.py\n@@ -1 +1,2 @@\n+result = eval(user_value)\n",
|
|
942
|
+
"expectedVerdict": "caution",
|
|
943
|
+
"weight": 2,
|
|
944
|
+
"expectedRuleIds": [
|
|
945
|
+
"custom-python-eval-exec"
|
|
946
|
+
]
|
|
947
|
+
},
|
|
948
|
+
{
|
|
949
|
+
"id": "python-final-pyproject-pass",
|
|
950
|
+
"preset": "python",
|
|
951
|
+
"kind": "final",
|
|
952
|
+
"description": "A verified pyproject metadata final answer should give the python preset a quiet final case.",
|
|
953
|
+
"content": "Updated pyproject metadata and ran pytest.",
|
|
954
|
+
"expectedVerdict": "pass",
|
|
955
|
+
"weight": 1,
|
|
956
|
+
"expectedRuleIds": [],
|
|
957
|
+
"absentRuleIds": [
|
|
958
|
+
"done-without-evidence"
|
|
959
|
+
]
|
|
960
|
+
},
|
|
961
|
+
{
|
|
962
|
+
"id": "sec-disable-tls-plan-block",
|
|
963
|
+
"preset": "security",
|
|
964
|
+
"kind": "plan",
|
|
965
|
+
"description": "TLS verification disabling should stay blocked by the security preset.",
|
|
966
|
+
"content": "Set NODE_TLS_REJECT_UNAUTHORIZED=0 for local debug after documenting the exception.",
|
|
967
|
+
"expectedVerdict": "block",
|
|
968
|
+
"weight": 2,
|
|
969
|
+
"expectedRuleIds": [
|
|
970
|
+
"custom-insecure-tls-disabled",
|
|
971
|
+
"configured-sensitive-domain-auth"
|
|
972
|
+
]
|
|
973
|
+
},
|
|
974
|
+
{
|
|
975
|
+
"id": "sec-chmod-command-block",
|
|
976
|
+
"preset": "security",
|
|
977
|
+
"kind": "command",
|
|
978
|
+
"description": "Broad chmod in a security preset command should include blocked-command and permission signals.",
|
|
979
|
+
"content": "chmod -R 777 ./secrets",
|
|
980
|
+
"expectedVerdict": "block",
|
|
981
|
+
"weight": 2,
|
|
982
|
+
"expectedRuleIds": [
|
|
983
|
+
"blocked-command-chmod-r-777",
|
|
984
|
+
"chmod-777",
|
|
985
|
+
"configured-sensitive-domain-secrets"
|
|
986
|
+
]
|
|
987
|
+
},
|
|
988
|
+
{
|
|
989
|
+
"id": "sec-broad-cors-diff-block",
|
|
990
|
+
"preset": "security",
|
|
991
|
+
"kind": "diff",
|
|
992
|
+
"description": "Wildcard CORS diffs should cover the security preset broad-CORS rule.",
|
|
993
|
+
"content": "diff --git a/src/cors.ts b/src/cors.ts\n--- a/src/cors.ts\n+++ b/src/cors.ts\n@@ -1 +1,2 @@\n+app.use(cors({ origin: \"*\" }));\n",
|
|
994
|
+
"expectedVerdict": "block",
|
|
995
|
+
"weight": 2,
|
|
996
|
+
"expectedRuleIds": [
|
|
997
|
+
"custom-broad-cors",
|
|
998
|
+
"configured-sensitive-domain-cors"
|
|
999
|
+
]
|
|
1000
|
+
},
|
|
1001
|
+
{
|
|
1002
|
+
"id": "sec-final-dependency-notes-pass",
|
|
1003
|
+
"preset": "security",
|
|
1004
|
+
"kind": "final",
|
|
1005
|
+
"description": "A verified dependency-note final answer should give the security preset a quiet final case.",
|
|
1006
|
+
"content": "Updated dependency notes and ran npm test.",
|
|
1007
|
+
"expectedVerdict": "pass",
|
|
1008
|
+
"weight": 1,
|
|
1009
|
+
"expectedRuleIds": [],
|
|
1010
|
+
"absentRuleIds": [
|
|
1011
|
+
"risky-domain",
|
|
1012
|
+
"done-without-evidence"
|
|
1013
|
+
]
|
|
856
1014
|
}
|
|
857
1015
|
]
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "memento-mori-jester",
|
|
3
|
-
"version": "0.1.
|
|
3
|
+
"version": "0.1.56",
|
|
4
4
|
"description": "A local court-jester sidecar for AI coding agents: review plans, commands, diffs, and final claims before they get too pleased with themselves.",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"repository": {
|