specpi 0.28.0 → 0.29.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +13 -0
- package/NPM_RELEASE.md +1 -1
- package/README.md +1 -1
- package/SECURITY_MODEL.md +14 -12
- package/THIRD_PARTY.md +6 -5
- package/extensions/jev-advisor/broker.mjs +0 -1
- package/extensions/jev-advisor/config.mjs +66 -52
- package/extensions/jev-advisor/gate.mjs +0 -14
- package/extensions/jev-advisor/index.ts +7 -149
- package/extensions/jev-advisor/key-source.mjs +1 -1
- package/extensions/jev-advisor/layer.mjs +8 -31
- package/package.json +2 -1
- package/scripts/jev-guard.mjs +154 -0
- package/scripts/packages.mjs +0 -56
- package/scripts/specpi.mjs +24 -51
- package/templates/settings.json +2 -1
- package/extensions/jev-advisor/questions/guard.mjs +0 -168
- package/extensions/jev-advisor/risk.mjs +0 -442
package/CHANGELOG.md
CHANGED
|
@@ -1,5 +1,18 @@
|
|
|
1
1
|
# Changelog
|
|
2
2
|
|
|
3
|
+
## 0.29.0 - 2026-09-20
|
|
4
|
+
|
|
5
|
+
- Return the command guard to `specpi-jev-guard`, and leave it there. 0.28.0 built the guard into the layer as its eighth system, for three stated reasons that were properties of the package as it stood: a global configuration file with no session scope, a key read from the environment only, and a fail-closed posture. Two of the three are fixed upstream. Guard 0.3.0 ships `/jev-guard setup | on | off [--global] | check | model | backend`, so it has a session scope and a switch of its own, and it resolves Pi's saved login before the environment, so `/login openrouter` serves it exactly as it serves the advisor. What remains is fail-closed, which is a disclosed trade rather than a defect. `extensions/jev-advisor/risk.mjs` and `questions/guard.mjs` are gone, the package is pinned again, and the base is eight.
|
|
6
|
+
- Keep the guard out of the Jev layer entirely, rather than half in it. There is no `/jev guard` command, no `systems.guard`, no `guard` pair in the layer's settings, no guard row in the Chat panel and no guard line in `/jev status`; the advisor imports nothing from it, and a test walks `extensions/jev-advisor/` to keep it that way. Two switches over one gate is what made the package's own shape a problem the first time, and adding a second one back would have reintroduced it with the roles swapped. The package owns its switch; SpecPi owns whether the package is installed and that it arrives off.
|
|
7
|
+
- Move the seam to `scripts/jev-guard.mjs`, because it is an installer concern and nothing else. It was a managed resource copied into every agent directory, where after this change nothing would have loaded it. The managed set drops from 34 files to 33, and the seam ships with the CLI instead.
|
|
8
|
+
- Write the inert posture at install and update, and nowhere else. The old seam re-asserted it at every session start, which is what made a `--global` save through the package's own command fail to survive a restart; it does not run at session time now, so the package's switch stays the package's between installer runs. The install-time write is still unconditional, because an install carrying a stale `enabled: true` from before the package was last unpinned would otherwise arm a fail-closed gate the moment it came back. That is the one case where establishing the default takes something away, so the run reports it by name and says which command restores it.
|
|
9
|
+
- Drop both older guard keys in schema 4 rather than migrating either. Schema 2 kept `guard: { enabled, startup }` and schema 3 kept `systems.guard`; neither was ever the authority over whether the guard runs, so keeping a copy could only produce a second answer that disagreed with the package's own file. Nothing about anyone's guard changes: a schema-2 preference had already been written through to that file by the last session that read it, and schema 3 shipped with the package unpinned.
|
|
10
|
+
- Drop the package-retirement machinery with the package it existed for. `retiredPackages`, `removeRetiredPackages` and `retireBasePackages` unpinned `specpi-jev-guard` by name on every install and update, including under `--skip-package-install`, and `specpi doctor` failed on an entry that was still configured. With the package pinned again all three would strip the entry SpecPi itself writes, so they are gone rather than filtered. The transaction's watched set returns to its narrower condition, which is correct again now that nothing writes settings outside it.
|
|
11
|
+
- Pin the command guard at 0.4.0 and show its counter in SpecPi Chat. The package publishes one status line per session under the key `jev-guard` -- classifier calls, blocked calls once there are any, and the last verdict -- and Chat already stored it, as a raw key/value row inside the collapsed generic runtime list behind up to twenty-four other widgets. It is a first-class readout now: a chip in the session footer beside the token and cache counts, showing the leading count, turning amber once something has been blocked, with the package's whole line in the tooltip. The key joins the reserved set so a busy session cannot crowd it out. Chat renders the string and does nothing else with it -- no recount from the session records, no reformatting, and no control, because the guard is configured in Pi and not here. The chip is absent exactly when the guard is not gating, since the package clears its own line when it is switched off or its audit display is.
|
|
12
|
+
- Leave `auditDisplay` to the package. It defaults to `status`, which is what publishes the counter, and asserting it in the install-time seam would take a display preference away from the user to guarantee a readout in one frontend.
|
|
13
|
+
- Raise the session call ceiling from 512 to 2048, and the per-system ceilings with it. 512 was sized the way 120 was before it -- against sessions shorter than the ones the layer now runs in. The long-session evals are what showed it: a session long enough to compact several times spends in the hundreds, so a backstop meant to be reachable only by a loop had drifted close enough to real use to stop a session that was working correctly. The per-system numbers move too, because the total is only a constraint while the per-system ceilings can add up past it: 2048 against a sum of 2322, scaled from the same firing frequencies rather than re-derived. `capability` stays at 2, alone, because it is bounded by construction rather than by frequency -- it asks once a session and then never again. A test pins the inequality rather than the literals, so the next change to either number has to consider the other. The whole ceiling is about six cents and two megabytes of digest.
|
|
14
|
+
- Take the guard out of the eval row it was never going to measure. `eval-harnesses.mjs` asked for `guard: true` and verified the advisor read it back, which now throws rather than silently measuring less than it asked for — the check working as designed. The disposable homes do not install the package, so the row does not claim it. The tier-6 and Terminal-Bench tables keep their recorded guard rows, labelled as the native guard they measured, because deleting a measurement is not the same as correcting one.
|
|
15
|
+
|
|
3
16
|
## 0.28.0 - 2026-09-18
|
|
4
17
|
|
|
5
18
|
- Read the key Pi already has. The layer resolved its credential from `OPENROUTER_API_KEY` and nothing else, while Pi had long since stored an OpenRouter key where it stores every provider credential — the `openrouter` entry that `/login openrouter` writes to `auth.json`. So a person who had logged in, whose every model call was working, was told `key: missing` by the one component that had opted out of Pi's credential store, and there was no interface anywhere that would have explained the gap. The advisor now follows Pi's own documented resolution order, the store first and then the environment, which is what makes `/login openrouter` the answer to "how do I configure the API key" rather than a second thing to set up. `/jev status` lists every source and marks the one in force, because "missing" with nothing to act on is what sent people looking for a key field that does not exist.
|
package/NPM_RELEASE.md
CHANGED
|
@@ -6,7 +6,7 @@ Publishing, tags, deprecation, ownership changes and GitHub Releases require exp
|
|
|
6
6
|
|
|
7
7
|
## Prepare
|
|
8
8
|
|
|
9
|
-
1. This candidate is SpecPi **0.
|
|
9
|
+
1. This candidate is SpecPi **0.29.0**, paired with the Chat **0.14.0** VSIX. Browser QA **0.3.0** is already independently published; do not republish or edit its source as part of this release. Choose an unused version; update `package.json`, the dated `CHANGELOG.md` entry, README, and the website. Check Chat's version and VSIX download links. Preserve historical changelog entries.
|
|
10
10
|
2. Validate:
|
|
11
11
|
|
|
12
12
|
```sh
|
package/README.md
CHANGED
|
@@ -44,7 +44,7 @@ Everything it touches is written down, versioned, and easy to undo.
|
|
|
44
44
|
|
|
45
45
|
## Measured context
|
|
46
46
|
|
|
47
|
-
This chart shows first-call context from a clean install: all
|
|
47
|
+
This chart shows first-call context from a clean install: all eight pinned packages, the working agreement, and the skills Pi finds. It has not been re-measured since the command guard returned to a pinned package rather than a native system. "Enabled" means browser QA, delegation, and web access are switched on, with no goal, scope, or improvement selection active.
|
|
48
48
|
|
|
49
49
|
The solid rows are measured by us, from the request each setup actually sends through one local test provider. That includes OpenCode, the DeepSeek Harness, and Oh My Pi, all measured as installed. The faded Codex CLI and Claude Code rows come from HarnessTax's published numbers, measured under their own setup. Treat those as a rough reference, not a head-to-head test. These are character counts. They say nothing about tokens, cost, or how well each tool does the job. The research page [breaks down the enabled setup by feature](https://tannermidd.github.io/SpecPi/research/#specpi), so you can see what each switch costs on its own.
|
|
50
50
|
|
package/SECURITY_MODEL.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
# Security model
|
|
2
2
|
|
|
3
|
-
SpecPi provides scope monitoring, an explicit harness improvement loop and an optional Jev advisor, and installs
|
|
3
|
+
SpecPi provides scope monitoring, an explicit harness improvement loop and an optional Jev advisor, and installs eight pinned packages as its default base. Extensions run as trusted code with Pi's permissions. Scope is not an OS sandbox or a general command guard. Use OS isolation for hostile code.
|
|
4
4
|
|
|
5
5
|
## Scope monitoring
|
|
6
6
|
|
|
@@ -30,29 +30,31 @@ The advisor also keeps `<agent-dir>/specpi/jev/usage.json`, the running call cou
|
|
|
30
30
|
|
|
31
31
|
The advisor holds no authority. It never grants a capability, never calls a tool and never allows one. Its only blocking action is to refuse a capability-gap report that looks like it carries a credential, which asks the model to rewrite its own text and discards nothing. Failure is silent, not closed: a timeout, HTTP error, missing key, missing consent, an exhausted per-system or session budget, or ungated confidence produces no advice, and the existing code path runs unchanged. Tool-result retention can shorten a large read-only result before it is appended; it never alters a write, edit or error result, and the replacement says the output is recoverable by re-running.
|
|
32
32
|
|
|
33
|
-
|
|
33
|
+
Two of the seven systems do something the other five do not, and both are off by default like everything else here.
|
|
34
34
|
|
|
35
35
|
**System 5, progress detection**, is the only one that can change what the model does. On a confident verdict that a session has stopped making progress it adds one fixed, code-written line at a turn boundary. It ships set to `notify`, which tells the person and cannot change the session; `message`, which appends the line for the model to read, is a deliberate opt-in. It is written once per session and never retracted, it never aborts or blocks, and it is suppressed entirely when the same call reports that a person would have to answer something first. Nothing the model produced ever enters the transcript: the line is chosen from a fixed table by failure mode.
|
|
36
36
|
|
|
37
|
-
**
|
|
37
|
+
The command guard is **not** part of this layer. It is a separate pinned package with its own gate, its own configuration file, its own commands and a fail-closed posture, and it has its own section below. It is named here because a reader who took "the advisor holds no authority" to cover everything SpecPi installs would be wrong about exactly one component. No switch in SpecPi turns it on: `/jev` does not mention it, the advisor imports nothing from it, and the only thing SpecPi ever writes to its configuration is the off side of it, at install time.
|
|
38
38
|
|
|
39
39
|
**System 7, untrusted-content classification**, prepends a fixed warning line to externally fetched content that confidently reads as instructions addressed to an agent. It applies only to web and browser tool results, never to the agent's own shell output or file reads. It is defence in depth and explicitly not a control: it never blocks, it has no authority over what the model then does, and it should not be relied on to stop prompt injection. Its value is that untrusted content in a fetched page is currently owned by nothing at all.
|
|
40
40
|
|
|
41
41
|
An earlier version of this document said its false-positive rate was measurable on tier 5 of the eval suite. It is not, and the re-run that checked found out why: **this system has never been called once**. It rides on a web or browser tool result, no task in any tier produces one, and the run that would have exercised Browser QA keeps it withdrawn because capability arming needs an interactive human. So the honest statement is that system 7 ships unmeasured, and the eval suite as it stands cannot measure it. That is a gap in the suite, not a property of the system, and it is stated here rather than left as an absent number that would read as a zero.
|
|
42
42
|
|
|
43
|
-
Settings live in `<agent-dir>/specpi/jev/settings.json`, written atomically with owner-only permissions. Links, irregular files, oversize files, an unrecognised schema and unparseable contents all read as off. The one exception is the layer's own previous
|
|
43
|
+
Settings live in `<agent-dir>/specpi/jev/settings.json`, written atomically with owner-only permissions. Links, irregular files, oversize files, an unrecognised schema and unparseable contents all read as off. The one exception is the layer's own previous schemas: an older file is migrated forward rather than read as unrecognised, because "collapse to all-off" is a rule for corrupt input and applying it to our own earlier version would silently disable a layer the user had switched on. Two keys are deliberately dropped rather than migrated. A `schema: 2` file kept a `guard` pair and a `schema: 3` file kept `systems.guard`; schema 4 keeps neither, because whether the command guard runs is not this file's answer to hold. The package keeps its own switch in its own configuration, and a stale copy here could only ever disagree with it. Call budgets are per system under a session total, so one busy system cannot exhaust the allowance of the others and leave them dead for the rest of the session with event ordering deciding which one won. Turning the layer on or off writes that preference, because a switch that forgets is not a switch; `--session` is how a one-off change is kept out of the file. The key is resolved the way Pi resolves every provider credential, in Pi's own documented order: the `openrouter` entry that `/login openrouter` writes to `<agent-dir>/auth.json`, then the environment variable. That is a deliberate, narrow exception to the rule that Pi state is never read, and it is bounded to exactly one question — the one `api_key` entry for the one provider this layer calls. Be precise about when: the key's *value* is read only on a call path the master switch already gates, but whether an entry *exists* is checked whenever status is displayed, including with the layer off, because that is the answer someone needs in order to configure it in the first place. A presence check reports a source name and nothing else. An `oauth` entry is ignored rather than unwrapped, because Pi refreshes those under its own lock and a second reader would race a rotation. The value is returned by a single function straight into a request header; nothing else in the layer receives it, and status output, the ledger and the Chat panel carry source names only. Pi trust decisions, sessions, missions and history are never read. `JEV_KEY_SOURCE=environment` restricts resolution to the environment, which is what this repository's own eval scripts set so a measured run cannot silently bill a developer's personal account.
|
|
44
44
|
|
|
45
45
|
## Command policy and the Jev guard
|
|
46
46
|
|
|
47
|
-
|
|
47
|
+
`specpi-jev-guard` is pinned in the base set but ships **inert**. Its own default is `enabled: true`, so left alone a fresh install would begin gating shell and file calls through a third-party service immediately; SpecPi writes `enabled: false`, and the package's own `/jev-guard setup` is how a human opts in — no SpecPi command does. `@gotgenes/pi-permission-system` stays pinned and, while the guard is off, decides every tool call exactly as it did before the guard existed.
|
|
48
48
|
|
|
49
|
-
|
|
49
|
+
Be precise about what the guard does once it is on, because it cannot be configured away. The guard is **fail-closed by design**: with no key, an unreachable endpoint, an answer it cannot parse, or a middle-band verdict in a session with no UI, it blocks the call and reports why. There is no setting that hands the decision back to the permission system instead — `uncertain` chooses between asking and denying the middle band, and only its `allow` value lets that band through unattended. So switching it on accepts that an outage stops gated work until it is switched off again. That trade is the user's to make, which is why SpecPi only ever writes the off side of it and why turning it on takes the package's own `/jev-guard` command.
|
|
50
50
|
|
|
51
|
-
|
|
51
|
+
SpecPi asserts only three fields in `<home>/.pi/jev-guard.json` and merges them into whatever is already there, so a user's own thresholds, safe-command globs and protected paths survive: `enabled: false`, `uncertain: "ask"` so a middle-band verdict asks a human wherever there is one to ask, and `backend: "openrouter"` so the guard and the advisor resolve the same credential. Off is a written configuration, not an absence of one. SpecPi writes only the global file; a project-local override under a workspace's `.pi/` remains the user's to make.
|
|
52
52
|
|
|
53
|
-
|
|
53
|
+
That write happens at install and update, and nowhere else. It deliberately does not repeat at session start, so the package's own `/jev-guard on [--global]` is the only switch and a saved choice survives every restart. It does repeat on the next installer run, unconditionally: an install left holding a stale `enabled: true` from before the package was last unpinned would otherwise arm a fail-closed gate the moment the package came back. That is the one case where establishing the default takes something away from someone, so the run reports it by name rather than doing it quietly.
|
|
54
54
|
|
|
55
|
-
|
|
55
|
+
As of 0.3.0 the guard resolves its key the way the advisor does and the way Pi resolves every provider credential: Pi's saved login first, then the environment. One `/login openrouter` therefore serves both without either component knowing about the other. `/jev-guard` reports its own state, including which backend and whether a key is present; `/jev status` does not, because the guard is not part of the layer it describes. Neither the guard nor the advisor is an OS sandbox.
|
|
56
|
+
|
|
57
|
+
0.4.0 publishes a per-session counter as a Pi status item under the key `jev-guard` — the number of classifier calls, the number of blocked calls once there are any, and the last verdict. SpecPi Chat renders that line in its session footer and does nothing else with it: it does not recount from the session records, reformat the text, or offer a control. The key is absent whenever the guard is off or its `auditDisplay` is, so the readout appears exactly when the guard is gating. Every judged call is also written to Pi's own session file by the package, which is the durable audit trail and is not SpecPi's to manage.
|
|
56
58
|
|
|
57
59
|
## Improvement authority and evidence
|
|
58
60
|
|
|
@@ -66,11 +68,11 @@ Wishlist records remain local under `<agent-dir>/specpi/`. Sanitization and salt
|
|
|
66
68
|
|
|
67
69
|
Package acquisition requests exact npm dependency saves through the child process environment and verifies the installed top-level versions before completing the transaction. A mismatch fails the operation and triggers managed-state rollback. Upstream transitive dependency ranges remain outside this pinning guarantee.
|
|
68
70
|
|
|
69
|
-
`plan` is read-only. Installation, updates, and removal require confirmation or `--yes`. SpecPi manages its two first-party extension families, improvement skill, manifest, AGENTS marker block, and the
|
|
71
|
+
`plan` is read-only. Installation, updates, and removal require confirmation or `--yes`. SpecPi manages its two first-party extension families, improvement skill, manifest, AGENTS marker block, and the eight package entries listed in `templates/settings.json`. Normal install/update runs `pi install npm:<name>@<pin>` for every default package. Only package entries are merged; existing resource filters and unrelated settings are retained. `--skip-package-install` allows a core-only install or preserves an already configured base during update, skipping Chromium setup too. Confirmed install/update otherwise invokes the installed Browser QA Node bin with bounded subprocesses to download Chromium and check readiness. `--skip-browser-install` skips that setup only; doctor still checks readiness. SpecPi never passes `--with-deps`, auto-installs OS libraries, or installs/removes Bun. No new shell profile integration is installed.
|
|
70
72
|
|
|
71
73
|
Managed configuration and files are locked and backed up before mutation; first-party writes are atomic and checksum-tracked. Failure restores the saved configuration and first-party files. Package acquisition runs upstream package-manager scripts and may leave downloads, dependency changes, or external script effects even after configuration rollback. Those effects, including downloaded browser-cache bytes, are outside SpecPi's transaction and survive uninstall. Updates require `--force` before replacing modified retained resources. Retired resources are backed up before deactivation; pre-install files are restored where ownership records identify them. Old runtime directories are moved into backups without inspecting their contents. Backups and private evidence remain after uninstall and can contain sensitive local material.
|
|
72
74
|
|
|
73
|
-
Legacy migration restores only recorded settings ownership, preserves differing user values, and removes only the SpecPi shell marker block before applying the new base. The installer does not enumerate or modify authentication, provider credential stores, trust, sessions, missions, history, or unrelated private evidence. Normal updates deliberately reapply the default package pins, retaining the original entry for removal.
|
|
75
|
+
Legacy migration restores only recorded settings ownership, preserves differing user values, and removes only the SpecPi shell marker block before applying the new base. The installer does not enumerate or modify authentication, provider credential stores, trust, sessions, missions, history, or unrelated private evidence. Normal updates deliberately reapply the default package pins, retaining the original entry for removal. Uninstall restores only package entries that still match the last installed value; user edits are preserved. Downloaded packages and tools are not deleted. Resources that SpecPi never owned require separate human management.
|
|
74
76
|
|
|
75
77
|
## Browser QA package
|
|
76
78
|
|
|
@@ -86,7 +88,7 @@ The optional **Destructive guard** preset replaces the complete global configura
|
|
|
86
88
|
|
|
87
89
|
## Upstream package boundary
|
|
88
90
|
|
|
89
|
-
The
|
|
91
|
+
The eight packages add their own extensions, tools, prompts, skills, network connections, filesystem operations, and subprocesses under their upstream defaults. They are not confined by the improvement loop's selection requirement. Permission System owns tool policies; SpecPi does not inject a duplicate guard or claim its coverage. Delegation starts real Pi child sessions in the same process tree, restricted to a frozen source snapshot and three read-only tools; experiments run the user's own `git` and create worktrees on disk. Neither is an OS sandbox. See [delegation](packages/delegation/SECURITY.md) and [experiments](packages/experiments/SECURITY.md). `pi-lens` and `pi-background-tasks` (including its Anthropic provider wrapper) are no longer part of the default base. Normal updates remove only unchanged entries originally added by SpecPi; pre-existing or modified entries and downloaded bytes remain. `--skip-package-install` preserves the old base. Restart Pi and Chat connections to unload retired extensions. Independently retained installations remain trusted upstream code; retained Pi Lens can still apply configured formatting/autofixes. Web access and usage reporting can contact services and use credentials through their upstream implementations. SpecPi's local-only wishlist collection policy does not describe all activity of those packages.
|
|
90
92
|
|
|
91
93
|
Top-level versions are pinned; upstream transitive dependency ranges are not frozen by SpecPi. `doctor` reads configured pins and installed package metadata, then invokes the installed Browser QA bin for real offline rendering, pixel-comparison, and accessibility checks when the managed base includes it. Doctor never downloads a browser, and missing Chromium or OS libraries fail with recovery guidance. It does not validate provider access or browser readiness for independently retained BetterWright. Core-only installations do not run browser checks. `check:base` acquires the packages, checks combined resource loading and Chat RPC startup, and exercises upstream approval, denial, and cancellation with synthetic context. It uses temporary home/configuration directories and sends no model prompt. The base check also exercises Node-only Chromium setup and offline Browser QA readiness; authenticated services, OS isolation, and every upstream tool's behavior remain outside that check. See [THIRD_PARTY.md](THIRD_PARTY.md) for sources and compatibility limits.
|
|
92
94
|
|
package/THIRD_PARTY.md
CHANGED
|
@@ -11,7 +11,7 @@ Development formatting uses Prettier **3.9.6** (MIT), ESLint **10.9.1** (MIT), `
|
|
|
11
11
|
|
|
12
12
|
## Default packages
|
|
13
13
|
|
|
14
|
-
Reviewed on 2026-09-16 against published npm metadata and integrity-verified source archives. All eight top-level packages declare the MIT license. Pins are authoritative in `templates/settings.json`.
|
|
14
|
+
Reviewed on 2026-09-16 against published npm metadata and integrity-verified source archives, and `specpi-jev-guard` 0.4.0 on 2026-09-20. All eight top-level packages declare the MIT license. Pins are authoritative in `templates/settings.json`.
|
|
15
15
|
|
|
16
16
|
SpecPi requests exact npm dependency saves for these pins and checks installed top-level versions before completing installation. The override applies to package acquisition without changing the user's global npm configuration.
|
|
17
17
|
|
|
@@ -24,16 +24,17 @@ SpecPi requests exact npm dependency saves for these pins and checks installed t
|
|
|
24
24
|
| pi-goal-x | 0.31.2 | [tmonk/pi-goal-x](https://github.com/tmonk/pi-goal-x) |
|
|
25
25
|
| @sreetej510/pi-usage | 0.10.0 | [Sreetej510/pi-extensions](https://github.com/Sreetej510/pi-extensions) |
|
|
26
26
|
| @gotgenes/pi-permission-system | 32.0.2 | [gotgenes/pi-packages](https://github.com/gotgenes/pi-packages) |
|
|
27
|
+
| specpi-jev-guard | 0.4.0 | [TannerMidd/specpi-jev-guard](https://github.com/TannerMidd/specpi-jev-guard) |
|
|
27
28
|
|
|
28
29
|
Transitive dependencies and their notices remain in Pi's npm installation tree. Top-level pins do not freeze upstream dependency ranges or constitute a full transitive security audit. Pi invokes npm with its upstream package-management semantics, including dependency lifecycle scripts. Browser QA has no install hook: confirmed SpecPi install/update explicitly invokes its installed Node setup bin, unless acquisition or browser setup is skipped. It downloads package-pinned Chromium without installing OS libraries. BetterWright is optional/manual and retains its own Bun-based setup; SpecPi neither removes Bun nor deletes user-owned tools. Usage reporting and web packages make their own provider/service connections. Consult upstream licenses and security policies before redistributing their components.
|
|
29
30
|
|
|
30
31
|
Pi Lens is no longer a default package. Normal updates retire only unchanged entries added by SpecPi; independent or modified entries and downloaded bytes remain, with their upstream notices. Restart Pi to unload Lens.
|
|
31
32
|
|
|
32
|
-
The combined base is tested with Pi 0.84.4. Pi Goal X declares Pi `>=0.83.0 <0.85.0`; compatibility with newer hosts is not assumed. SpecPi's former custom browser, structural-search, background-task, and command-guard implementations, DonSeTch, and Pi themes have been removed. Its delegation and experiment implementations were not discarded: they now ship as the independent `specpi-delegation` and `specpi-experiments` packages described below. Removal restores owned package settings but does not delete downloaded upstream packages or tools. Retired private runtimes remain in local backups with their notices.
|
|
33
|
+
The combined base is tested with Pi 0.84.4. Pi Goal X declares Pi `>=0.83.0 <0.85.0`; compatibility with newer hosts is not assumed. SpecPi's former custom browser, structural-search, background-task, and native command-guard implementations, DonSeTch, and Pi themes have been removed; command gating is the pinned `specpi-jev-guard` package's again. Its delegation and experiment implementations were not discarded: they now ship as the independent `specpi-delegation` and `specpi-experiments` packages described below. Removal restores owned package settings but does not delete downloaded upstream packages or tools. Retired private runtimes remain in local backups with their notices.
|
|
33
34
|
|
|
34
35
|
## Network services
|
|
35
36
|
|
|
36
|
-
The optional Jev
|
|
37
|
+
The optional Jev advisor and `specpi-jev-guard` both reach TypeSafe's System One endpoint. Neither is a bundled dependency: the advisor is first-party source that uses Node's built-in `fetch` and declares no package, and the guard is a pinned MIT package with no declared runtime dependencies. Both resolve their key the way every other Pi provider credential is resolved, in Pi's own documented order: the `openrouter` entry that `/login openrouter` writes to Pi's `auth.json`, then `OPENROUTER_API_KEY` from the environment (`TYPESAFE_API_KEY` when the direct API is selected — `JEV_BACKEND=typesafe` for the advisor, `/jev-guard backend typesafe` for the guard). Guard 0.3.0 is the release that added the credential-store half; before it the package read the environment alone. The two keys are not interchangeable: the other service rejects the wrong one with a bare 401. SpecPi never provisions or stores a provider credential, and reads one only to place it in the request header of the call the user has switched on.
|
|
37
38
|
|
|
38
39
|
Requests go to `openrouter.ai` by default, or to `api.typesafe.ai` on the direct backend, unless `TYPESAFE_BASE_URL` redirects them, which exists so tests never reach the network and the eval proxy can price advisor traffic. Retention and processing of what is sent are governed by TypeSafe and, on the default route, by OpenRouter as well -- not by SpecPi; the advisor ships off, asks before its first transmission and records a hash of every payload locally. The frozen eval price list carries `jev-1.13.0` at $0.042/MTok input and free output so a measured SpecPi + Jev row never reports a cost that excludes its own advisor.
|
|
39
40
|
|
|
@@ -41,7 +42,7 @@ Worth stating plainly, because it is the part a reader is most likely to assume
|
|
|
41
42
|
|
|
42
43
|
## Standalone delegation and experiments
|
|
43
44
|
|
|
44
|
-
`packages/delegation` and `packages/experiments` are first-party packages extracted from SpecPi's own retired harness code under MIT. Neither bundles third-party runtime code or declares a production dependency; every runtime import is a Node builtin or a Pi-supplied optional peer. Experiments invokes the user's own `git` as an external program through Pi's `exec` seam; Git is not bundled, vendored or version-pinned. Delegation's extraction drops the Command Guard admission path, which
|
|
45
|
+
`packages/delegation` and `packages/experiments` are first-party packages extracted from SpecPi's own retired harness code under MIT. Neither bundles third-party runtime code or declares a production dependency; every runtime import is a Node builtin or a Pi-supplied optional peer. Experiments invokes the user's own `git` as an external program through Pi's `exec` seam; Git is not bundled, vendored or version-pinned. Delegation's extraction drops the Command Guard admission path, which it does not integrate with, and reports its guard posture as `absent`. See their dependency notices and security boundaries: [delegation](packages/delegation/THIRD_PARTY.md) / [boundary](packages/delegation/SECURITY.md), [experiments](packages/experiments/THIRD_PARTY.md) / [boundary](packages/experiments/SECURITY.md).
|
|
45
46
|
|
|
46
47
|
## Standalone browser QA
|
|
47
48
|
|
|
@@ -51,4 +52,4 @@ The separately released `packages/browser-qa` source reuses the retired QA imple
|
|
|
51
52
|
|
|
52
53
|
The website uses the bundled IBM Plex Sans and Plex Mono fonts under the SIL Open Font License 1.1; see [`site/fonts/LICENSE.txt`](https://github.com/TannerMidd/SpecPi/blob/main/site/fonts/LICENSE.txt). The website's scripts and diagrams are first-party code and assets. The README loads public package/license badges from Shields.io and build status from GitHub. Website fonts and media are not included in the npm package.
|
|
53
54
|
|
|
54
|
-
SpecPi Chat 0.
|
|
55
|
+
SpecPi Chat 0.14.0 is a separately packaged VS Code extension with no bundled runtime dependencies. It uses VS Code's host APIs and Pi's RPC protocol. Generic tool output, visible custom messages, widgets, and dialogs stay owned by their upstream packages. Playwright **1.62.1** (Apache-2.0, [Microsoft Playwright](https://github.com/microsoft/playwright)) is a pinned development dependency for Chat's rendering tests; its browser is used for those checks and is not shipped in either artifact. The default Browser QA package independently uses the same pinned Playwright version for its runtime. Chat's global Destructive guard preset is a full replacement configuration reviewed against Permission System 32.0.2's schema and native pattern semantics. No upstream patch, new dependency, policy-layer merger, or independent command evaluator is included. See [the security model](SECURITY_MODEL.md) for its limits.
|
|
@@ -28,7 +28,6 @@ export const SYSTEM_LABELS = Object.freeze({
|
|
|
28
28
|
progress: "Progress and thrash detection",
|
|
29
29
|
untrusted: "Untrusted-content classification",
|
|
30
30
|
capability: "Turn-zero capability arming",
|
|
31
|
-
guard: "Command guard",
|
|
32
31
|
});
|
|
33
32
|
|
|
34
33
|
export function createBroker(options = {}) {
|
|
@@ -5,6 +5,10 @@
|
|
|
5
5
|
// name and never by value, because "how do I configure this" is a question asked before enabling
|
|
6
6
|
// anything -- see key-source.mjs.
|
|
7
7
|
//
|
|
8
|
+
// The command guard is not here at all. It is a separate pinned package that keeps its own
|
|
9
|
+
// configuration and its own switch, and nothing in this file tracks it -- see scripts/jev-guard.mjs
|
|
10
|
+
// for the one place SpecPi touches it, which is install time.
|
|
11
|
+
//
|
|
8
12
|
// The file is SpecPi's own, hardened the same way as web-access and capability-policy: atomic
|
|
9
13
|
// write, mode 0600, symlinks refused, and a missing or unreadable file read as off.
|
|
10
14
|
|
|
@@ -22,14 +26,6 @@ export const SYSTEM_NAMES = Object.freeze([
|
|
|
22
26
|
"progress",
|
|
23
27
|
"untrusted",
|
|
24
28
|
"capability",
|
|
25
|
-
// The command guard, native since schema 3. It used to be a separate pinned package with its own
|
|
26
|
-
// global configuration file, which is why it used to carry its own switch here: a second switch,
|
|
27
|
-
// outside the master, with its own startup preference and its own persistence rules. Those rules
|
|
28
|
-
// disagreed with the layer's often enough to be their own source of defects -- a preference
|
|
29
|
-
// erased by a command that had decided nothing about the guard, a state written by one command
|
|
30
|
-
// and reverted by the next session. As a system it is gated, budgeted, reported and toggled by
|
|
31
|
-
// exactly the same code as the other seven.
|
|
32
|
-
"guard",
|
|
33
29
|
]);
|
|
34
30
|
|
|
35
31
|
/**
|
|
@@ -52,8 +48,8 @@ export const SYSTEM_NAMES = Object.freeze([
|
|
|
52
48
|
export const NUDGE_MODES = Object.freeze(["notify", "message"]);
|
|
53
49
|
|
|
54
50
|
const MAX_SETTINGS_BYTES = 4096;
|
|
55
|
-
const MAX_CALL_BUDGET =
|
|
56
|
-
const MAX_TOTAL_BUDGET =
|
|
51
|
+
const MAX_CALL_BUDGET = 1024;
|
|
52
|
+
const MAX_TOTAL_BUDGET = 2048;
|
|
57
53
|
|
|
58
54
|
/**
|
|
59
55
|
* One shared budget could not survive a turn-level system. A system that fires once per turn would
|
|
@@ -61,8 +57,11 @@ const MAX_TOTAL_BUDGET = 512;
|
|
|
61
57
|
* session, and which one won would be decided by event ordering rather than by anyone's policy.
|
|
62
58
|
*
|
|
63
59
|
* So the ceiling is two-level: each system gets its own, and the total is a real constraint because
|
|
64
|
-
* it is deliberately less than their sum
|
|
65
|
-
*
|
|
60
|
+
* it is deliberately less than their sum -- 2048 against 2322. That relationship is the invariant,
|
|
61
|
+
* not either number: raising the total without raising the per-system ceilings would leave a total
|
|
62
|
+
* no combination of systems could ever reach, which is a limit that reads as a limit and is not
|
|
63
|
+
* one. `tests/jev-advisor.test.mjs` pins the inequality so a future change to one has to consider
|
|
64
|
+
* the other. Running out of one system's budget stops that system and nothing else.
|
|
66
65
|
*
|
|
67
66
|
* The per-system numbers follow how often each one can fire: retention on every large read-only
|
|
68
67
|
* result, compaction once or twice in a long session, gap per report, sources per delegation batch.
|
|
@@ -70,7 +69,7 @@ const MAX_TOTAL_BUDGET = 512;
|
|
|
70
69
|
export const DEFAULT_BUDGETS = Object.freeze({
|
|
71
70
|
// A backstop, not a working limit, and the number says which. Measured, a full tier-3 task -- a
|
|
72
71
|
// 120-step repair chain over about 25 model requests -- spends 4 to 7 calls, and the busiest
|
|
73
|
-
// attempt ever recorded spent 12. A session would have to run for days before
|
|
72
|
+
// attempt ever recorded spent 12. A session would have to run for days before 2048 bound
|
|
74
73
|
// anything a person was actually doing, which is the point: the ceiling should only ever be hit
|
|
75
74
|
// by a loop, and hitting it should therefore be information rather than an inconvenience.
|
|
76
75
|
//
|
|
@@ -78,35 +77,37 @@ export const DEFAULT_BUDGETS = Object.freeze({
|
|
|
78
77
|
// runs for two minutes; an interactive session runs for a day, and a turn-level system at one
|
|
79
78
|
// call every four turns reaches 120 somewhere in the afternoon and then goes quiet without
|
|
80
79
|
// having found anything wrong. A ceiling that a normal long session reaches is not protecting
|
|
81
|
-
// anyone, it is just failing later than it looks.
|
|
80
|
+
// anyone, it is just failing later than it looks. 512 was the same mistake one order of
|
|
81
|
+
// magnitude further out, and the long-session evals are what showed it: a session long enough
|
|
82
|
+
// to compact several times spends in the hundreds, so the backstop sat close enough to real
|
|
83
|
+
// use to be reachable by a session that was working correctly.
|
|
82
84
|
//
|
|
83
|
-
// Cost is not what these are for. A call is about $0.00003, so the whole total is about
|
|
84
|
-
//
|
|
85
|
-
//
|
|
86
|
-
//
|
|
87
|
-
//
|
|
88
|
-
total:
|
|
89
|
-
|
|
90
|
-
|
|
91
|
-
|
|
92
|
-
|
|
85
|
+
// Cost is not what these are for. A call is about $0.00003, so the whole total is about six
|
|
86
|
+
// cents. They bound two things that do not get cheaper with scale: how much digest leaves the
|
|
87
|
+
// machine for a third party, at up to 1 KB a call, and how much awaited latency a runaway loop
|
|
88
|
+
// can add before something stops it. Two megabytes of digest and an announced stop is the shape
|
|
89
|
+
// of the trade.
|
|
90
|
+
total: 2048,
|
|
91
|
+
// The per-system numbers move with the total, because a total the per-system ceilings can never
|
|
92
|
+
// add up to is not a constraint at all -- see below. They are scaled rather than re-derived:
|
|
93
|
+
// each one's rationale is a firing frequency, and none of those frequencies changed.
|
|
94
|
+
retention: 832,
|
|
95
|
+
compaction: 48,
|
|
96
|
+
gap: 192,
|
|
97
|
+
sources: 128,
|
|
93
98
|
// Turn-level, but gated behind local signals and a four-turn cooldown, so it only spends on
|
|
94
99
|
// sessions that already look wrong. The ceiling is what stops a genuinely thrashing session
|
|
95
100
|
// from spending the total on being told it is thrashing.
|
|
96
|
-
progress:
|
|
101
|
+
progress: 704,
|
|
97
102
|
// Usually free: when retention is on, system 7's question rides the call retention was already
|
|
98
103
|
// making against the same state. This ceiling only binds when retention is off, or when the
|
|
99
104
|
// fetched result is too small for retention to be interested in it.
|
|
100
|
-
untrusted:
|
|
105
|
+
untrusted: 416,
|
|
101
106
|
// Once per session by construction, and only when local signals already suggest it. Two rather
|
|
102
|
-
// than one so a retried first turn is not silently un-served.
|
|
107
|
+
// than one so a retried first turn is not silently un-served. The one number here that does not
|
|
108
|
+
// scale with the total, because it is not sized by a frequency: the system asks once and then
|
|
109
|
+
// never again, so a larger ceiling would buy nothing and would only misdescribe what it does.
|
|
103
110
|
capability: 2,
|
|
104
|
-
// Per gated tool call that local rules could not settle, so its frequency is retention's rather
|
|
105
|
-
// than compaction's -- and like retention, most calls never reach it: read-only commands and
|
|
106
|
-
// ordinary project writes are answered locally for nothing. Running out means the guard defers
|
|
107
|
-
// to the permission system for the rest of the session, which is what it does for every other
|
|
108
|
-
// kind of unavailability.
|
|
109
|
-
guard: 208,
|
|
110
111
|
});
|
|
111
112
|
|
|
112
113
|
/** 0 is a real budget meaning no calls. Switching a system off is what `systems[name] = false` is for. */
|
|
@@ -143,7 +144,7 @@ export function regularFile(file, label) {
|
|
|
143
144
|
/** Every unknown shape collapses to the same all-off default rather than a partial enable. */
|
|
144
145
|
export function defaultSettings() {
|
|
145
146
|
return {
|
|
146
|
-
schema:
|
|
147
|
+
schema: 4,
|
|
147
148
|
master: false,
|
|
148
149
|
startup: false,
|
|
149
150
|
systems: Object.fromEntries(SYSTEM_NAMES.map((name) => [name, false])),
|
|
@@ -187,36 +188,49 @@ function migrate(raw) {
|
|
|
187
188
|
}
|
|
188
189
|
|
|
189
190
|
/**
|
|
190
|
-
* Schema
|
|
191
|
-
*
|
|
192
|
-
*
|
|
191
|
+
* Schema 4 removes every trace of the command guard from this file, from either shape it took.
|
|
192
|
+
*
|
|
193
|
+
* Schema 2 kept a `guard: { enabled, startup }` pair, from when SpecPi re-asserted the package's
|
|
194
|
+
* switch at every session start; schema 3 made the guard the layer's eighth system under
|
|
195
|
+
* `systems.guard`. Both keys go, because neither answer is SpecPi's to hold any more: the package
|
|
196
|
+
* owns its switch in its own file, and a stale copy here could only ever disagree with it.
|
|
193
197
|
*
|
|
194
|
-
*
|
|
195
|
-
*
|
|
196
|
-
*
|
|
197
|
-
* layer that is off, which is inactive -- the guard used to sit outside the master switch and now
|
|
198
|
-
* does not. That direction is deliberate: a gate quietly becoming inactive is recoverable in one
|
|
199
|
-
* command, and a gate quietly becoming active is how a session stops being able to run anything.
|
|
198
|
+
* Dropping them changes nothing about whether anyone's guard is on. A schema-2 file's preference
|
|
199
|
+
* had already been written through to the package's own configuration by the last session that
|
|
200
|
+
* read it, and schema 3 shipped with no guard package installed at all.
|
|
200
201
|
*/
|
|
201
|
-
function
|
|
202
|
-
const
|
|
202
|
+
function migrateToFour(raw) {
|
|
203
|
+
const { guard: _pair, ...rest } = raw ?? {};
|
|
204
|
+
const { guard: _system, ...systems } = rest.systems ?? {};
|
|
203
205
|
|
|
204
|
-
|
|
206
|
+
return { ...rest, schema: 4, systems };
|
|
207
|
+
}
|
|
205
208
|
|
|
206
|
-
|
|
209
|
+
/**
|
|
210
|
+
* What the advisor will read, given a settings object, without writing it anywhere.
|
|
211
|
+
*
|
|
212
|
+
* Exported for callers that compose a settings file for somewhere other than this process's own
|
|
213
|
+
* agent directory -- the eval harness writes one into a disposable home -- and need to check what
|
|
214
|
+
* they composed. Building a literal and trusting it is how the harness came to run every published
|
|
215
|
+
* tier with a system it believed it had enabled switched off: it hardcoded a schema number, the
|
|
216
|
+
* migration for that number read a preference from a key that shape does not have, and nothing ever
|
|
217
|
+
* compared the result to the ask. Compose, then normalize, then assert -- not compose and trust.
|
|
218
|
+
*/
|
|
219
|
+
export function normalizeSettings(raw) {
|
|
220
|
+
return normalize(raw);
|
|
207
221
|
}
|
|
208
222
|
|
|
209
223
|
function normalize(raw) {
|
|
210
224
|
const one = raw?.schema === 1 ? migrate(raw) : raw;
|
|
211
|
-
const source = one?.schema === 2 ?
|
|
212
|
-
if (source?.schema !==
|
|
225
|
+
const source = one?.schema === 2 || one?.schema === 3 ? migrateToFour(one) : one;
|
|
226
|
+
if (source?.schema !== 4) {
|
|
213
227
|
return defaultSettings();
|
|
214
228
|
}
|
|
215
229
|
|
|
216
230
|
const systems = Object.fromEntries(SYSTEM_NAMES.map((name) => [name, source.systems?.[name] === true]));
|
|
217
231
|
|
|
218
232
|
return {
|
|
219
|
-
schema:
|
|
233
|
+
schema: 4,
|
|
220
234
|
master: source.master === true,
|
|
221
235
|
startup: source.startup === true,
|
|
222
236
|
systems,
|
|
@@ -252,9 +266,9 @@ export function writeFileAtomic(file, contents) {
|
|
|
252
266
|
}
|
|
253
267
|
|
|
254
268
|
export function saveSettings(settings) {
|
|
255
|
-
// A caller handing back
|
|
269
|
+
// A caller handing back an older shape is migrated rather than reset, so a round trip through
|
|
256
270
|
// an old reader cannot quietly disable the layer.
|
|
257
|
-
const next = normalize(
|
|
271
|
+
const next = normalize([1, 2, 3].includes(settings?.schema) ? settings : { ...settings, schema: 4 });
|
|
258
272
|
const file = settingsFile();
|
|
259
273
|
if (fs.existsSync(file)) {
|
|
260
274
|
regularFile(file, "Jev settings");
|
|
@@ -156,20 +156,6 @@ export const THRESHOLDS = Object.freeze({
|
|
|
156
156
|
high: 0.85,
|
|
157
157
|
low: 0.15,
|
|
158
158
|
}),
|
|
159
|
-
guard: Object.freeze({
|
|
160
|
-
// The same measured Score operating point as every other system, written out rather than
|
|
161
|
-
// inherited by falling through `thresholdsFor`'s default. The guard asked under the name
|
|
162
|
-
// "gap" for exactly as long as it took to notice that adding a `guard` entry would then have
|
|
163
|
-
// changed nothing -- a silent no-op on the one system whose action takes a tool call away.
|
|
164
|
-
scoreConfidence: 0.6,
|
|
165
|
-
boundary: 0.3,
|
|
166
|
-
choiceConfidence: 0.75,
|
|
167
|
-
margin: 0.2,
|
|
168
|
-
// Unused: this system reads only the Score side. Kept so every system has a full set, and
|
|
169
|
-
// so the calibration tests cover this entry like any other.
|
|
170
|
-
high: 0.85,
|
|
171
|
-
low: 0.15,
|
|
172
|
-
}),
|
|
173
159
|
sources: Object.freeze({
|
|
174
160
|
scoreConfidence: 0.6,
|
|
175
161
|
boundary: 0.3,
|