memento-mori-jester 0.1.66 → 0.1.67
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +6 -0
- package/ROADMAP.md +2 -1
- package/docs/DEMO.md +4 -4
- package/docs/RELEASE_NOTES_v0.1.67.md +38 -0
- package/examples/fixtures/README.md +1 -1
- package/examples/fixtures/preset-review-cases.json +90 -0
- package/package.json +1 -1
package/CHANGELOG.md
CHANGED
|
@@ -4,6 +4,12 @@ All notable changes to Memento Mori Jester are tracked here.
|
|
|
4
4
|
|
|
5
5
|
## Unreleased
|
|
6
6
|
|
|
7
|
+
## 0.1.67
|
|
8
|
+
|
|
9
|
+
- Added six real-world quiet-pass fixtures for security, web, node, and python preset slices, growing the corpus to 166 fixtures.
|
|
10
|
+
- Strengthened safe near-miss evidence for static analysis commands, checksum commands, accessible frontend markup, static internal links, Node linting, and Python linting.
|
|
11
|
+
- Refreshed demo, roadmap, fixture docs, and release notes for the expanded preset curation batch.
|
|
12
|
+
|
|
7
13
|
## 0.1.66
|
|
8
14
|
|
|
9
15
|
- Added real-world preset fixtures for node, python, infra, and AI slices, growing the corpus to 160 fixtures.
|
package/ROADMAP.md
CHANGED
|
@@ -6,6 +6,7 @@ Memento Mori Jester is usable today as a CLI, MCP server, GitHub Action, and git
|
|
|
6
6
|
|
|
7
7
|
## Recently Shipped
|
|
8
8
|
|
|
9
|
+
- Security/web/node/python preset fixture curation in v0.1.67, adding real-world quiet-pass examples while keeping thin, quiet-pass, feasible pass-case, and preset-kind gaps at zero.
|
|
9
10
|
- Real-world low-count preset fixture batch in v0.1.66, adding node, python, infra, and AI examples while keeping thin, quiet-pass, and feasible pass-case gaps at zero.
|
|
10
11
|
- Feasible pass-case fixture curation in v0.1.65, adding matched-pass examples for low-severity tone/planning rules and stopping curation from asking for impossible pass cases on hard rules.
|
|
11
12
|
- Final thin-rule fixture precision pass in v0.1.64, clearing all remaining thin coverage gaps across built-in, structural, custom, configured sensitive-domain, and blocked-command rule families.
|
|
@@ -55,7 +56,7 @@ Memento Mori Jester is usable today as a CLI, MCP server, GitHub Action, and git
|
|
|
55
56
|
|
|
56
57
|
## Product Ideas
|
|
57
58
|
|
|
58
|
-
- Collect real-world reports for the next lowest-count preset slices:
|
|
59
|
+
- Collect real-world reports for the next lowest-count preset slices: AI first, then node, python, and security.
|
|
59
60
|
- Add more framework-specific false-positive examples from real reports so tuning guidance keeps getting sharper.
|
|
60
61
|
- Add a Markdown export for fixture reports so maintainers can paste coverage snapshots into issues or release notes.
|
|
61
62
|
|
package/docs/DEMO.md
CHANGED
|
@@ -192,8 +192,8 @@ Project config: none loaded
|
|
|
192
192
|
Fixture tuning evidence:
|
|
193
193
|
Support: limited
|
|
194
194
|
Confidence: medium
|
|
195
|
-
Total fixtures checked:
|
|
196
|
-
Weighted fixtures checked:
|
|
195
|
+
Total fixtures checked: 166
|
|
196
|
+
Weighted fixtures checked: 317.9
|
|
197
197
|
Matching fixtures: 11
|
|
198
198
|
Weighted matches: 23
|
|
199
199
|
Expected-match weight: 18
|
|
@@ -202,7 +202,7 @@ Edge-case matches: 0
|
|
|
202
202
|
Quiet-pass fixtures: 5
|
|
203
203
|
Quiet-pass weight: 3.6
|
|
204
204
|
By kind: command 0, plan 5, diff 5, final 1
|
|
205
|
-
Fixture coverage: 11/
|
|
205
|
+
Fixture coverage: 11/166 (7.2% weighted)
|
|
206
206
|
By verdict: pass 0, caution 3, block 8
|
|
207
207
|
Matched fixture samples:
|
|
208
208
|
infra-public-ingress-block: Public ingress should block in low-risk-tolerance infra repos.
|
|
@@ -353,7 +353,7 @@ Preset packs:
|
|
|
353
353
|
|
|
354
354
|
## 13. Review Fixtures
|
|
355
355
|
|
|
356
|
-
The fixture suite in `examples/fixtures/preset-review-cases.json` captures small real-usage examples with expected `pass`, `caution`, or `block` verdicts. It also includes matched-pass examples for low-severity rules, quiet-pass `absentRuleIds` examples that prove noisy rules stay silent for safe near-misses, stack-specific coverage for every built-in preset, quiet-pass boundaries across built-in, structural, custom, and preset/config-derived rules, second firing examples for preset blocked-command rules, second examples for AI/API, framework custom, built-in, and configured sensitive-domain rules, and real-world low-count preset examples. These examples are run by `npm test`, so preset tuning changes stay visible.
|
|
356
|
+
The fixture suite in `examples/fixtures/preset-review-cases.json` captures small real-usage examples with expected `pass`, `caution`, or `block` verdicts. It also includes matched-pass examples for low-severity rules, quiet-pass `absentRuleIds` examples that prove noisy rules stay silent for safe near-misses, stack-specific coverage for every built-in preset, quiet-pass boundaries across built-in, structural, custom, and preset/config-derived rules, second firing examples for preset blocked-command rules, second examples for AI/API, framework custom, built-in, and configured sensitive-domain rules, and real-world low-count preset examples across node, python, web, infra, AI, and security slices. These examples are run by `npm test`, so preset tuning changes stay visible.
|
|
357
357
|
|
|
358
358
|
Maintainers can run `npm run fixtures:report` to see coverage by verdict, kind, preset, rule family, and preset slice. The report also includes a `Curation next` section that points at the next useful fixture batch, such as thin rules, feasible pass-case evidence, rule-family gaps, or lower-count presets.
|
|
359
359
|
|
|
@@ -0,0 +1,38 @@
|
|
|
1
|
+
# Memento Mori Jester v0.1.67
|
|
2
|
+
|
|
3
|
+
This release continues the fixture-report curation track. It adds practical quiet-pass examples for the lowest preset slices after v0.1.66 while keeping review behavior unchanged.
|
|
4
|
+
|
|
5
|
+
## What Changed
|
|
6
|
+
|
|
7
|
+
- Added 6 fixture cases, growing the corpus from 160 to 166 fixtures.
|
|
8
|
+
- Added security preset quiet-pass examples for:
|
|
9
|
+
- Static analysis scan commands.
|
|
10
|
+
- Checksum verification commands.
|
|
11
|
+
- Added web preset quiet-pass examples for:
|
|
12
|
+
- Accessible button markup.
|
|
13
|
+
- Static internal route links.
|
|
14
|
+
- Added node and python quiet-pass examples for:
|
|
15
|
+
- Node lint commands.
|
|
16
|
+
- Python ruff checks.
|
|
17
|
+
- Kept thin rule coverage, quiet-pass gaps, feasible pass-case gaps, and preset/kind gaps at zero.
|
|
18
|
+
|
|
19
|
+
## Public Interface
|
|
20
|
+
|
|
21
|
+
- No CLI command changes.
|
|
22
|
+
- No config schema changes.
|
|
23
|
+
- No rule matching, scoring, or verdict behavior changes.
|
|
24
|
+
- No MCP, playground, GitHub Action, or npm publishing changes.
|
|
25
|
+
|
|
26
|
+
## Release Validation
|
|
27
|
+
|
|
28
|
+
```powershell
|
|
29
|
+
npm.cmd test
|
|
30
|
+
npm.cmd run demo:svg:check
|
|
31
|
+
npm.cmd run fixtures:report
|
|
32
|
+
npm.cmd run fixtures:report -- --json
|
|
33
|
+
npm.cmd run pack:dry
|
|
34
|
+
git diff --check
|
|
35
|
+
node .\dist\cli.js tune coverage --no-config
|
|
36
|
+
node .\dist\cli.js tune risky-domain --json --no-config
|
|
37
|
+
git diff | node .\dist\cli.js diff --fail-on block --subject "v0.1.67 preset quiet-pass fixtures"
|
|
38
|
+
```
|
|
@@ -21,7 +21,7 @@ Maintainer triage guidance lives in [docs/MAINTAINER_TRIAGE.md](../../docs/MAINT
|
|
|
21
21
|
- Second firing examples for AI and API custom rules around provider keys, model-output execution, raw SQL, and webhook signature checks.
|
|
22
22
|
- Second firing examples for remaining framework custom rules across security, infra, node, python, and web presets.
|
|
23
23
|
- Second firing examples for remaining built-in and configured sensitive-domain thin rules, leaving no thin coverage gaps.
|
|
24
|
-
- Real-world low-count preset examples for node, python, infra, and
|
|
24
|
+
- Real-world low-count preset examples for node, python, web, infra, AI, and security workflows.
|
|
25
25
|
- Fixture metadata like `weight` and `edgeCase` to support precision-weighted tuning evidence.
|
|
26
26
|
|
|
27
27
|
## Local Check
|
|
@@ -2055,5 +2055,95 @@
|
|
|
2055
2055
|
"absentRuleIds": [
|
|
2056
2056
|
"untested-final"
|
|
2057
2057
|
]
|
|
2058
|
+
},
|
|
2059
|
+
{
|
|
2060
|
+
"id": "sec-semgrep-scan-command-pass",
|
|
2061
|
+
"preset": "security",
|
|
2062
|
+
"kind": "command",
|
|
2063
|
+
"description": "Static analysis scan commands should not trip security preset danger checks.",
|
|
2064
|
+
"content": "semgrep scan --config p/ci --sarif --output semgrep.sarif",
|
|
2065
|
+
"expectedVerdict": "pass",
|
|
2066
|
+
"weight": 2,
|
|
2067
|
+
"expectedRuleIds": [],
|
|
2068
|
+
"absentRuleIds": [
|
|
2069
|
+
"blocked-command-chmod-r-777",
|
|
2070
|
+
"custom-broad-cors",
|
|
2071
|
+
"custom-insecure-tls-disabled"
|
|
2072
|
+
]
|
|
2073
|
+
},
|
|
2074
|
+
{
|
|
2075
|
+
"id": "sec-checksum-command-pass",
|
|
2076
|
+
"preset": "security",
|
|
2077
|
+
"kind": "command",
|
|
2078
|
+
"description": "Checksum verification commands should stay quiet in security preset repos.",
|
|
2079
|
+
"content": "shasum -a 256 dist/memento-mori-jester.tgz",
|
|
2080
|
+
"expectedVerdict": "pass",
|
|
2081
|
+
"weight": 2,
|
|
2082
|
+
"expectedRuleIds": [],
|
|
2083
|
+
"absentRuleIds": [
|
|
2084
|
+
"blocked-command-chmod-r-777",
|
|
2085
|
+
"custom-insecure-tls-disabled",
|
|
2086
|
+
"pipe-to-shell"
|
|
2087
|
+
]
|
|
2088
|
+
},
|
|
2089
|
+
{
|
|
2090
|
+
"id": "web-accessible-button-diff-pass",
|
|
2091
|
+
"preset": "web",
|
|
2092
|
+
"kind": "diff",
|
|
2093
|
+
"description": "Accessible button markup should not trip web HTML or storage risk checks.",
|
|
2094
|
+
"content": "diff --git a/src/Button.tsx b/src/Button.tsx\n--- a/src/Button.tsx\n+++ b/src/Button.tsx\n@@ -1 +1,2 @@\n+export function SaveButton() { return <button type=\"button\" aria-label=\"Save changes\">Save</button>; }\n",
|
|
2095
|
+
"expectedVerdict": "pass",
|
|
2096
|
+
"weight": 2,
|
|
2097
|
+
"expectedRuleIds": [],
|
|
2098
|
+
"absentRuleIds": [
|
|
2099
|
+
"custom-web-public-secret-name",
|
|
2100
|
+
"custom-web-storage-sensitive-value",
|
|
2101
|
+
"custom-web-unsafe-html-injection"
|
|
2102
|
+
]
|
|
2103
|
+
},
|
|
2104
|
+
{
|
|
2105
|
+
"id": "web-static-route-link-diff-pass",
|
|
2106
|
+
"preset": "web",
|
|
2107
|
+
"kind": "diff",
|
|
2108
|
+
"description": "Static internal route links should not look like open redirect changes.",
|
|
2109
|
+
"content": "diff --git a/src/Nav.tsx b/src/Nav.tsx\n--- a/src/Nav.tsx\n+++ b/src/Nav.tsx\n@@ -1 +1,2 @@\n+export const settingsHref = \"/settings/profile\";\n",
|
|
2110
|
+
"expectedVerdict": "pass",
|
|
2111
|
+
"weight": 2,
|
|
2112
|
+
"expectedRuleIds": [],
|
|
2113
|
+
"absentRuleIds": [
|
|
2114
|
+
"custom-web-open-redirect-shape",
|
|
2115
|
+
"custom-web-public-secret-name",
|
|
2116
|
+
"custom-web-storage-sensitive-value"
|
|
2117
|
+
]
|
|
2118
|
+
},
|
|
2119
|
+
{
|
|
2120
|
+
"id": "node-lint-command-pass",
|
|
2121
|
+
"preset": "node",
|
|
2122
|
+
"kind": "command",
|
|
2123
|
+
"description": "Node lint commands should stay quiet around install-script and publish checks.",
|
|
2124
|
+
"content": "npm run lint -- --max-warnings=0",
|
|
2125
|
+
"expectedVerdict": "pass",
|
|
2126
|
+
"weight": 2,
|
|
2127
|
+
"expectedRuleIds": [],
|
|
2128
|
+
"absentRuleIds": [
|
|
2129
|
+
"blocked-command-npm-publish-force",
|
|
2130
|
+
"custom-node-install-script-change",
|
|
2131
|
+
"custom-node-env-production-change"
|
|
2132
|
+
]
|
|
2133
|
+
},
|
|
2134
|
+
{
|
|
2135
|
+
"id": "python-ruff-check-command-pass",
|
|
2136
|
+
"preset": "python",
|
|
2137
|
+
"kind": "command",
|
|
2138
|
+
"description": "Python lint commands should not trip eval, pickle, or break-system package checks.",
|
|
2139
|
+
"content": "python -m ruff check src tests",
|
|
2140
|
+
"expectedVerdict": "pass",
|
|
2141
|
+
"weight": 2,
|
|
2142
|
+
"expectedRuleIds": [],
|
|
2143
|
+
"absentRuleIds": [
|
|
2144
|
+
"blocked-command-pip-install-break-system-packages",
|
|
2145
|
+
"custom-python-eval-exec",
|
|
2146
|
+
"custom-python-pickle-load"
|
|
2147
|
+
]
|
|
2058
2148
|
}
|
|
2059
2149
|
]
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "memento-mori-jester",
|
|
3
|
-
"version": "0.1.
|
|
3
|
+
"version": "0.1.67",
|
|
4
4
|
"description": "A local court-jester sidecar for AI coding agents: review plans, commands, diffs, and final claims before they get too pleased with themselves.",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"repository": {
|