@alexeiled/claude-router 1.9.0 → 1.10.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude-plugin/plugin.json +1 -1
- package/CHANGELOG.md +22 -0
- package/README.md +3 -3
- package/docs/activity-routing.md +35 -34
- package/docs/architecture.md +5 -7
- package/docs/configuration.md +25 -23
- package/docs/evaluation.md +8 -9
- package/docs/native-router.md +15 -16
- package/docs/router-band.svg +3 -21
- package/docs/router-pane-classifier.svg +82 -63
- package/docs/router-pane-now.svg +95 -109
- package/docs/router-pane-policy.svg +70 -0
- package/docs/router-pane-routes.svg +103 -0
- package/docs/router-pane-usage.svg +100 -127
- package/docs/user-guide.md +63 -49
- package/hooks/native-router.mjs +20 -50
- package/lib/activity-stats.mjs +21 -70
- package/lib/band.mjs +3 -6
- package/lib/config.mjs +11 -8
- package/lib/cost.mjs +3 -3
- package/lib/display.mjs +14 -41
- package/lib/panel.mjs +651 -477
- package/lib/route.mjs +4 -53
- package/lib/subagents.mjs +12 -17
- package/lib/view.mjs +3 -3
- package/package.json +1 -1
- package/types/index.d.ts +10 -36
- package/docs/router-pane-routing.svg +0 -150
package/docs/native-router.md
CHANGED
|
@@ -10,7 +10,7 @@ The classifier receives the current prompt and at most six preceding user or ass
|
|
|
10
10
|
|
|
11
11
|
The default tiers are defined in [Configuration](configuration.md#built-in-defaults). Policy uses vote hysteresis, repeated tool errors, context fit, model availability, and switching-cost estimates. The [architecture](architecture.md#request-flow) explains the event boundary and failure handling.
|
|
12
12
|
|
|
13
|
-
The activity is what the turn produces: `code`, `debug`, `explore`, `plan`, `review`, `ops`, or `docs`. A route is the tier's own route, the base route, with the activity's override on top. In `on`, the default since 1.7, it applies the overrides.
|
|
13
|
+
The activity is what the turn produces: `code`, `debug`, `explore`, `plan`, `review`, `ops`, or `docs`. A route is the tier's own route, the base route, with the activity's override on top. In `on`, the default since 1.7, it applies the overrides. The activity question reuses the same prompt and dialogue; no other text is sent. With `off` the classifier is asked for the tier only. [Route by activity](user-guide.md#route-by-activity) explains the modes, [Activity routing](activity-routing.md) the default matrix and its evidence, and [Configuration](configuration.md#activity-routing) the schema.
|
|
14
14
|
|
|
15
15
|
## Controls and session modes
|
|
16
16
|
|
|
@@ -20,7 +20,7 @@ The activity is what the turn produces: `code`, `debug`, `explore`, `plan`, `rev
|
|
|
20
20
|
| `/router auto` | Enable automatic routing. |
|
|
21
21
|
| `/router off` | Turn routing off and keep Claude's selected model. |
|
|
22
22
|
| `/router pin <tier>` | Pin the next turn and tool continuations. Routing on must already be enabled. |
|
|
23
|
-
| `/router activities <off\|
|
|
23
|
+
| `/router activities <off\|on>` | Set the activity routing mode. Written to `router.json` at once; **Undo** in the pane reverts it. |
|
|
24
24
|
| `/model <name>` | Select a model and turn routing off. `/router auto` turns it back on. |
|
|
25
25
|
|
|
26
26
|
The pane's **Set up** and **Credentials → Edit** buttons open Claude Code's secure plugin configuration. Claude Code refuses `$.command.run` from inside a `command.run` hook, so the Mod starts that dialog from a timer after the press returns.
|
|
@@ -29,24 +29,23 @@ Mode belongs to a Claude Code session. Clear starts a new session with routing o
|
|
|
29
29
|
|
|
30
30
|
## Router pane
|
|
31
31
|
|
|
32
|
-
The status band is one line above the prompt: a tier meter, the activity, the route, a short reason, classifier support, and context and cache use. Segments drop by priority when the band is narrow: classifier support first, then context and cache, then the activity, then the reason. Hovering reveals pins, **Turn off**, and a two-row view; while routing is off, **Turn on** sits on the band itself, so the band carries one routing control at a time. A fresh session that starts with routing off because of its model shows `<model> is not a routing tier` on the band until the mode changes. The band yields to surveys. In a subagent's transcript it reads `subagent model chosen at spawn`, or `subagents keep their own model` with subagent routing off
|
|
32
|
+
The status band is one line above the prompt: a tier meter, the activity, the route, a short reason, classifier support, and context and cache use. Segments drop by priority when the band is narrow: classifier support first, then context and cache, then the activity, then the reason. Hovering reveals pins, **Turn off**, and a two-row view; while routing is off, **Turn on** sits on the band itself, so the band carries one routing control at a time. A fresh session that starts with routing off because of its model shows `<model> is not a routing tier` on the band until the mode changes. The band yields to surveys. In a subagent's transcript it reads `subagent model chosen at spawn`, or `subagents keep their own model` with subagent routing off. A model change between turns raises a toast. A pin, or a step that changes only the effort, such as `medium` to `high` on the defaults, raises none. While the classifier runs, the turn's spinner says `Choosing model`. In Manual mode or when routing is unavailable, the prompt footer carries `routing off` or `routing unavailable`. The **Router** button opens the pane. The pane has five tabs, Now, Routes, Policy, Classifier, and Usage, under one line with the routing on/off pair and the classifier state. The [user guide](user-guide.md#open-the-router-pane) describes each tab.
|
|
33
33
|
|
|
34
34
|
| Reading | Meaning and limits |
|
|
35
35
|
| ---------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
|
|
36
|
-
|
|
|
37
|
-
| Classifier support | Per-tier probabilities from the last classification
|
|
38
|
-
| Activity | The classifier's activity choice with its share
|
|
39
|
-
|
|
|
40
|
-
| Replies | The tier that served each of the last 30 main-conversation replies; a dot where the router did not choose. A second row of letters names each reply's activity: `c` code, `d` debug, `e` explore, `p` plan, `r` review, `o` ops, `w` docs. |
|
|
36
|
+
| Next turn / Served | The requested model and effort, with the tier's own model beside an activity override. **Served** appears only when the engine answered with another model. Actual effort is not reported. |
|
|
37
|
+
| Classifier support | Per-tier probabilities from the last classification; under **Why**, the support for the switch against the bar the policy required, and the switch cost. Pins and skipped calls leave it empty. |
|
|
38
|
+
| Activity | The classifier's activity choice as a verb with its share, the two next-best answers, and the threshold at which an activity applies; `uncertain` shown dim. Empty with routing off, a pin, or no answer. |
|
|
39
|
+
| Last replies | The tier that served each of the last 30 main-conversation replies, a dot where the router did not choose, the model switches between them, and the replies per tier and per activity. |
|
|
41
40
|
| Routing vs your model (Usage) | Routed replies at configured list prices against the same tokens on your model (the model `/model` selects now, at the session effort; after a `/model` change, the whole session against the new one), this session and since the last reset (each reply against the model selected when it ran); the session against the other configured models; the difference split into cheaper models, stronger than yours, and cache writes from switches. `too early` below 10 replies. Output length is held the same; answer quality is not measured. |
|
|
42
|
-
|
|
|
43
|
-
| Across sessions (
|
|
41
|
+
| By activity (Usage) | Counts for this session: turns, requests and share per activity, its `est. cost` at configured list prices (`—` unless every reply had a price) and the route it was `mostly on`; switches by tier and by activity, and activity moves refused in `on`; tool agreement. |
|
|
42
|
+
| Across sessions (Classifier) | The counts kept since the last reset: labelled turns, tool agreement on the classifier's raw answer, overall and for `code`, `ops` and `explore`, the two largest mismatches, activity moves inside a tier taken and refused, and escalations after a cheaper activity move. The active classifier's p95 latency shows on its **Deadline** line. `/router` text shows the agreement. |
|
|
44
43
|
| Cost | Claude Code's native usage value. A plan's list-price estimates are not subscription cash charges. |
|
|
45
44
|
| Context bar | Maximum available observed and local estimated context, compared with the routed model's window. The fit rule reserves 20%. |
|
|
46
|
-
| Observed / estimated input | Claude's local context reading and the router's best current context estimate. `unknown` blocks a move to a smaller window.
|
|
45
|
+
| Observed / estimated input | Under **details** on Usage: Claude's local context reading and the router's best current context estimate. `unknown` blocks a move to a smaller window. |
|
|
47
46
|
| Cache reuse | Last response's cache-read tokens divided by its reported input counters. |
|
|
48
47
|
| Cache read / written; Output | Response usage counters. Cache warmth does not prove a particular TTL. |
|
|
49
|
-
| Input per reply |
|
|
48
|
+
| Input per reply | Under **details** on Usage: up to 30 observed main-conversation input sizes, scaled from the lowest to the highest reading. |
|
|
50
49
|
| Classifier header | Active classifier state and elapsed time. Missing-key, missing-account, busy, and paused skips have no network latency reading. |
|
|
51
50
|
| Next-turn difference | Configured-price range for the suggested tier versus the incumbent on the next request. Negative means estimated lower cost. |
|
|
52
51
|
| Conservative payback | Conditional later-turn estimate based on configured cache prices, future reads, and the last output size. It is not measured savings. |
|
|
@@ -56,7 +55,7 @@ The router keeps no bill. Routing vs your model is a configured-price estimate,
|
|
|
56
55
|
|
|
57
56
|
## Routing and classifier settings
|
|
58
57
|
|
|
59
|
-
The
|
|
58
|
+
The Routes tab edits each tier's model alias and effort, the activity overrides and mode; the Policy tab edits the baseline tier and four policy controls. Both share one draft. The draft does not affect the active turn, survives a tab change or closing the pane, and is dropped at a new session. **Save** validates the whole file with the same loader the Mod starts with, writes `router.json` for future turns, and keeps unrelated keys. A route, activity override, or policy value equal to the built-in default is removed from the file, so later default changes still reach it. The Classifier tab writes the classifier choice and its deadline at once, and shows each classifier's last checked-in activity probe on the model it ran, from `lib/probe-results.mjs`, as columns beside its host and status. **Undo** reverts the settings the last pane write changed, from any tab, until the next write or a new session.
|
|
60
59
|
|
|
61
60
|
| Control | Values in the pane | Effect |
|
|
62
61
|
| ------------------ | ---------------------------------- | ---------------------------------------------------------------------------------------- |
|
|
@@ -66,16 +65,16 @@ The Routing tab edits each tier's model alias and effort, the baseline tier, the
|
|
|
66
65
|
| Credits cap | $0.50, $1, $2, $5 | Largest estimated cold write on a `credits` model. |
|
|
67
66
|
| Activity threshold | 50%, 60%, 70%, 80% | `policy.activityMass`: the least probability at which an activity applies. |
|
|
68
67
|
|
|
69
|
-
|
|
68
|
+
The Routes tab starts with the **Activity routing** selector, `off · on`, and a hint for the mode, and a yellow line when the overrides do not run: activity routing is `off`, routing is off, or routing is unavailable. Below it is one grid of the draft: a column per tier, the **every turn** row with each tier's own route, and a row per activity whose cells show the route it runs (`models key·effort`, such as `sonnet·high`), `·` for the tier's route, `°` for a built-in default, and **●** for an unsaved edit. Each cell is a plain Button; selecting one opens its editor under the grid: a model and an effort Select, the cell's state, **Use tier model** to drop an override, and **Restore default** for a changed or dropped built-in one. A dropped built-in override is saved as the tier's own route, because a file that only omitted it would get the built-in back. Yellow notes flag a cell stronger than the tier above, and the only cell on its cache, which adds one; a cell equal to its tier's route but saved in the file says `no effect`. A line counts the prompt caches the routes use, one per model where efforts share a cache and one per (model, effort) pair where they do not, counting only tier routes until the mode is `on`, and another flags two neighbouring tiers with the same route. **Reset routes to defaults** resets the tier routes and the baseline tier; pending override and mode edits stay in the draft. The Policy tab writes each control inside its sentence and names the default beside a changed value, and ends with the `subagentRouting` mode, which is set in `router.json`. The Usage tab's **BY ACTIVITY** table adds each activity's `est. cost`, its replies at list prices, and the route it was `mostly on`; the Classifier tab's **ACROSS SESSIONS** adds the escalations after a cheaper activity move. The Usage tab's **Reset stats** clears the activity counts and routing vs your model, for this session and across sessions.
|
|
70
69
|
|
|
71
|
-
The
|
|
70
|
+
The Classifier tab lists every configured classifier as a row with its service host (`this machine` for a local one), its activity probe and p95 wait, and whether its key and endpoint settings are complete. Selecting a row writes `classifier` to `router.json` at once, or removes it for the default, through the same validation, and resets the new classifier's failure count. A turn already being classified finishes with its own classifier; its readings stay off the pane. **Undo** returns to the previous classifier. The deadline saves at once too, and a built-in classifier's default deadline is written as no override. **Sends** names the host that receives prompt text. The **Deadline** line shows the active classifier's p95 wait across sessions, or its probe's before any turn, in yellow when it is slower than the deadline.
|
|
72
71
|
|
|
73
72
|
The pane refuses to write through a symlink. A failed validation names the setting and leaves the file unchanged. New model aliases and the other supported fields need an edit to the active profile's `router.json`.
|
|
74
73
|
|
|
75
74
|
## Safety and failure states
|
|
76
75
|
|
|
77
76
|
- A missing key or account ID, a classifier failure, or a policy refusal keeps the current model. Network refusal is never bypassed with a helper process.
|
|
78
|
-
- A missing, malformed, or timed-out activity answer keeps the running activity in `on`; the tier answer still applies.
|
|
77
|
+
- A missing, malformed, or timed-out activity answer keeps the running activity in `on`; the tier answer still applies. It does not count as a classifier failure. If the whole classifier call fails, the running route stays. Activity statistics are written inside a guard: a failed store read or write loses that turn's counts and never fails a turn.
|
|
79
78
|
- Three launched classifier failures open a 60-second pause for that classifier. One in-flight request is allowed per classifier in each active Mod instance. Pending host HTTP work blocks another request until it settles.
|
|
80
79
|
- A `router.json` with v0.8 gateway keys or the 1.1 `jev` section marks the router unavailable until the [migration command](configuration.md#convert-an-older-routerjson) converts it.
|
|
81
80
|
- Unsupported Claude Code versions and leftover v0.8 gateway settings (the `jev-router` model or the `127.0.0.1:43170` base URL) mark the router unavailable. `/router` lists the settings to remove. A local gateway does not run as part of this Mod.
|
package/docs/router-band.svg
CHANGED
|
@@ -1,11 +1,11 @@
|
|
|
1
|
-
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 922
|
|
1
|
+
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 922 444" role="img" aria-labelledby="title desc">
|
|
2
2
|
<title id="title">The Router band above the Claude Code prompt</title>
|
|
3
|
-
<desc id="desc">
|
|
3
|
+
<desc id="desc">Six band states drawn by the router code: routed to high, two rows with the hover row, a pending pin, a missing classifier key, routing off, and an activity move with activity routing on.</desc>
|
|
4
4
|
<style>
|
|
5
5
|
text { font-family: ui-monospace, SFMono-Regular, Menlo, Consolas, 'Liberation Mono', monospace; font-size: 13px; }
|
|
6
6
|
.cap { font-family: system-ui, -apple-system, 'Segoe UI', sans-serif; font-size: 12px; fill: #9a988f; }
|
|
7
7
|
</style>
|
|
8
|
-
<rect width="922" height="
|
|
8
|
+
<rect width="922" height="444" rx="8" fill="#1c1c1c"/>
|
|
9
9
|
<text class="cap" x="20" y="30">Routing on: routed to the high tier on a clear jump</text>
|
|
10
10
|
<rect x="12" y="38" width="897.6" height="29" rx="5" fill="#232323"/>
|
|
11
11
|
<text x="24.0" y="56" fill="#e0708a" xml:space="preserve">▂</text>
|
|
@@ -135,22 +135,4 @@
|
|
|
135
135
|
<text x="531.0" y="419" fill="#d0d0d0" xml:space="preserve"> · cache hit </text>
|
|
136
136
|
<text x="632.4" y="419" fill="#87d787" xml:space="preserve">100%</text>
|
|
137
137
|
<text x="679.2" y="419" fill="#d0d0d0" xml:space="preserve">Router</text>
|
|
138
|
-
<text class="cap" x="20" y="458">Activity routing in shadow: the label is shown, the base route still runs</text>
|
|
139
|
-
<rect x="12" y="466" width="897.6" height="29" rx="5" fill="#232323"/>
|
|
140
|
-
<text x="24.0" y="484" fill="#5f9fe0" xml:space="preserve">▂</text>
|
|
141
|
-
<text x="31.8" y="484" fill="#5f9fe0" xml:space="preserve">▄</text>
|
|
142
|
-
<text x="39.6" y="484" fill="#7c7c7c" xml:space="preserve">▆</text>
|
|
143
|
-
<text x="47.4" y="484" fill="#7c7c7c" xml:space="preserve">█</text>
|
|
144
|
-
<rect x="55.2" y="470" width="39.0" height="18" rx="4" fill="#5f9fe0"/>
|
|
145
|
-
<text x="55.2" y="484" fill="#0d1016" font-weight="700" xml:space="preserve"> low </text>
|
|
146
|
-
<text x="102.0" y="484" fill="#7c7c7c" xml:space="preserve">coding (shadow) → </text>
|
|
147
|
-
<text x="242.4" y="484" fill="#d0d0d0" xml:space="preserve">Haiku 5.5 · high</text>
|
|
148
|
-
<text x="367.2" y="484" fill="#7c7c7c" xml:space="preserve"> · </text>
|
|
149
|
-
<text x="406.2" y="484" fill="#7c7c7c" xml:space="preserve">= fits</text>
|
|
150
|
-
<text x="453.0" y="484" fill="#7c7c7c" xml:space="preserve"> · </text>
|
|
151
|
-
<text x="492.0" y="484" fill="#d0d0d0" xml:space="preserve">ctx </text>
|
|
152
|
-
<text x="523.2" y="484" fill="#87d787" xml:space="preserve">40%</text>
|
|
153
|
-
<text x="546.6" y="484" fill="#d0d0d0" xml:space="preserve"> · cache hit </text>
|
|
154
|
-
<text x="648.0" y="484" fill="#87d787" xml:space="preserve">100%</text>
|
|
155
|
-
<text x="694.8" y="484" fill="#d0d0d0" xml:space="preserve">Router</text>
|
|
156
138
|
</svg>
|
|
@@ -1,74 +1,93 @@
|
|
|
1
|
-
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0
|
|
1
|
+
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 672 591" role="img" aria-labelledby="title desc">
|
|
2
2
|
<title id="title">Router pane, Classifier tab</title>
|
|
3
|
-
<desc id="desc">
|
|
3
|
+
<desc id="desc">One row per classifier to compare: where the prompt goes, its activity probe, its p95 wait and whether its credentials are complete, with Set up for a missing Jev API key; the active classifier’s deadline against its wait, the host that receives the prompt, health and credentials; the agreement with tools across sessions; and Undo after a switch.</desc>
|
|
4
4
|
<style>
|
|
5
5
|
text { font-family: ui-monospace, SFMono-Regular, Menlo, Consolas, 'Liberation Mono', monospace; font-size: 13px; }
|
|
6
6
|
.cap { font-family: system-ui, -apple-system, 'Segoe UI', sans-serif; font-size: 12px; fill: #9a988f; }
|
|
7
7
|
</style>
|
|
8
|
-
<rect width="
|
|
9
|
-
<rect x="10" y="10" width="
|
|
8
|
+
<rect width="672" height="591" rx="8" fill="#1c1c1c"/>
|
|
9
|
+
<rect x="10" y="10" width="652" height="571" rx="6" fill="none" stroke="#3f5f8f"/>
|
|
10
10
|
<text x="24.0" y="34" fill="#5fafd7" font-weight="700" xml:space="preserve">ROUTING</text>
|
|
11
11
|
<rect x="94.2" y="20" width="62.4" height="18" rx="4" fill="#87afff"/>
|
|
12
12
|
<text x="94.2" y="34" fill="#0d1016" font-weight="700" xml:space="preserve">[ ◉ on ]</text>
|
|
13
13
|
<rect x="164.4" y="20" width="70.2" height="18" rx="4" fill="#2e3340"/>
|
|
14
14
|
<text x="164.4" y="34" fill="#d0d0d0" xml:space="preserve">[ ○ off ]</text>
|
|
15
|
-
<text x="
|
|
16
|
-
<
|
|
17
|
-
<
|
|
18
|
-
<
|
|
19
|
-
<
|
|
20
|
-
<
|
|
21
|
-
<
|
|
22
|
-
<
|
|
23
|
-
<
|
|
24
|
-
<
|
|
25
|
-
<
|
|
26
|
-
<
|
|
27
|
-
<text x="
|
|
28
|
-
<text x="
|
|
29
|
-
<text x="
|
|
30
|
-
<
|
|
31
|
-
<
|
|
32
|
-
<text x="
|
|
33
|
-
<text x="
|
|
34
|
-
<
|
|
35
|
-
<text x="
|
|
36
|
-
<text x="
|
|
37
|
-
<rect x="
|
|
38
|
-
<text x="
|
|
39
|
-
<
|
|
40
|
-
<text x="
|
|
41
|
-
<text x="
|
|
42
|
-
<
|
|
43
|
-
<text x="
|
|
44
|
-
<text x="
|
|
45
|
-
<
|
|
46
|
-
<text x="24.0" y="
|
|
47
|
-
<
|
|
48
|
-
<text x="
|
|
49
|
-
<text x="
|
|
50
|
-
<text x="
|
|
51
|
-
<rect x="
|
|
52
|
-
<text x="
|
|
53
|
-
<text x="
|
|
54
|
-
<
|
|
55
|
-
<text x="
|
|
56
|
-
<text x="
|
|
57
|
-
<
|
|
58
|
-
<text x="
|
|
59
|
-
<
|
|
60
|
-
<text x="
|
|
61
|
-
<text x="
|
|
62
|
-
<text x="
|
|
63
|
-
<text x="
|
|
64
|
-
<text x="
|
|
65
|
-
<
|
|
66
|
-
<text x="
|
|
67
|
-
<text x="
|
|
68
|
-
<text x="24.0" y="
|
|
69
|
-
<text x="
|
|
70
|
-
<
|
|
71
|
-
<text x="
|
|
72
|
-
<
|
|
73
|
-
<text x="
|
|
15
|
+
<text x="250.2" y="34" fill="#87d787" xml:space="preserve">Clef Flash ready</text>
|
|
16
|
+
<rect x="24.0" y="39" width="54.6" height="18" rx="4" fill="#2e3340"/>
|
|
17
|
+
<text x="24.0" y="53" fill="#d0d0d0" xml:space="preserve">[ Now ]</text>
|
|
18
|
+
<rect x="86.4" y="39" width="78.0" height="18" rx="4" fill="#2e3340"/>
|
|
19
|
+
<text x="86.4" y="53" fill="#d0d0d0" xml:space="preserve">[ Routes ]</text>
|
|
20
|
+
<rect x="172.2" y="39" width="78.0" height="18" rx="4" fill="#2e3340"/>
|
|
21
|
+
<text x="172.2" y="53" fill="#d0d0d0" xml:space="preserve">[ Policy ]</text>
|
|
22
|
+
<rect x="258.0" y="39" width="109.2" height="18" rx="4" fill="#87afff"/>
|
|
23
|
+
<text x="258.0" y="53" fill="#0d1016" font-weight="700" xml:space="preserve">[ Classifier ]</text>
|
|
24
|
+
<rect x="375.0" y="39" width="70.2" height="18" rx="4" fill="#2e3340"/>
|
|
25
|
+
<text x="375.0" y="53" fill="#d0d0d0" xml:space="preserve">[ Usage ]</text>
|
|
26
|
+
<rect x="453.0" y="39" width="39.0" height="18" rx="4" fill="#2e3340"/>
|
|
27
|
+
<text x="453.0" y="53" fill="#d0d0d0" xml:space="preserve">[ ? ]</text>
|
|
28
|
+
<text x="24.0" y="91" fill="#5fafd7" font-weight="700" xml:space="preserve">CLASSIFIER</text>
|
|
29
|
+
<text x="102.0" y="91" fill="#7c7c7c" xml:space="preserve"> · asked once per new turn · a pick saves at once</text>
|
|
30
|
+
<text x="24.0" y="110" fill="#7c7c7c" xml:space="preserve"> prompt goes to probe p95 status</text>
|
|
31
|
+
<rect x="24.0" y="115" width="124.8" height="18" rx="4" fill="#2e3340"/>
|
|
32
|
+
<text x="24.0" y="129" fill="#d0d0d0" xml:space="preserve">[ ○ Jev ]</text>
|
|
33
|
+
<text x="156.6" y="129" fill="#7c7c7c" xml:space="preserve">api.typesafe.ai</text>
|
|
34
|
+
<text x="320.4" y="129" fill="#d0d0d0" xml:space="preserve">70/70</text>
|
|
35
|
+
<text x="382.8" y="129" fill="#d0d0d0" xml:space="preserve">299 ms</text>
|
|
36
|
+
<text x="460.8" y="129" fill="#d7af5f" xml:space="preserve">○ no API key </text>
|
|
37
|
+
<rect x="570.0" y="115" width="78.0" height="18" rx="4" fill="#2e3340"/>
|
|
38
|
+
<text x="570.0" y="129" fill="#d0d0d0" xml:space="preserve">[ Set up ]</text>
|
|
39
|
+
<rect x="24.0" y="134" width="124.8" height="18" rx="4" fill="#2e3340"/>
|
|
40
|
+
<text x="24.0" y="148" fill="#d0d0d0" xml:space="preserve">[ ○ Clef ]</text>
|
|
41
|
+
<text x="156.6" y="148" fill="#7c7c7c" xml:space="preserve">api.cloudflare.com</text>
|
|
42
|
+
<text x="320.4" y="148" fill="#d0d0d0" xml:space="preserve">69/70</text>
|
|
43
|
+
<text x="382.8" y="148" fill="#d0d0d0" xml:space="preserve">883 ms</text>
|
|
44
|
+
<text x="460.8" y="148" fill="#87d787" xml:space="preserve">● ready</text>
|
|
45
|
+
<rect x="24.0" y="153" width="124.8" height="18" rx="4" fill="#87afff"/>
|
|
46
|
+
<text x="24.0" y="167" fill="#0d1016" font-weight="700" xml:space="preserve">[ ◉ Clef Flash ]</text>
|
|
47
|
+
<text x="156.6" y="167" fill="#7c7c7c" xml:space="preserve">api.cloudflare.com</text>
|
|
48
|
+
<text x="320.4" y="167" fill="#d0d0d0" xml:space="preserve">69/70</text>
|
|
49
|
+
<text x="382.8" y="167" fill="#d0d0d0" xml:space="preserve">874 ms</text>
|
|
50
|
+
<text x="460.8" y="167" fill="#87d787" xml:space="preserve">● ready</text>
|
|
51
|
+
<rect x="24.0" y="172" width="124.8" height="18" rx="4" fill="#2e3340"/>
|
|
52
|
+
<text x="24.0" y="186" fill="#d0d0d0" xml:space="preserve">[ ○ OpenAI ]</text>
|
|
53
|
+
<text x="156.6" y="186" fill="#7c7c7c" xml:space="preserve">api.openai.com</text>
|
|
54
|
+
<text x="320.4" y="186" fill="#d0d0d0" xml:space="preserve">70/70</text>
|
|
55
|
+
<text x="382.8" y="186" fill="#d0d0d0" xml:space="preserve">286 ms</text>
|
|
56
|
+
<text x="460.8" y="186" fill="#d7af5f" xml:space="preserve">○ no API key </text>
|
|
57
|
+
<rect x="570.0" y="172" width="78.0" height="18" rx="4" fill="#2e3340"/>
|
|
58
|
+
<text x="570.0" y="186" fill="#d0d0d0" xml:space="preserve">[ Set up ]</text>
|
|
59
|
+
<rect x="24.0" y="191" width="124.8" height="18" rx="4" fill="#2e3340"/>
|
|
60
|
+
<text x="24.0" y="205" fill="#d0d0d0" xml:space="preserve">[ ○ Ollama ]</text>
|
|
61
|
+
<text x="156.6" y="205" fill="#87d787" xml:space="preserve">this machine</text>
|
|
62
|
+
<text x="320.4" y="205" fill="#d0d0d0" xml:space="preserve">66/70</text>
|
|
63
|
+
<text x="382.8" y="205" fill="#d0d0d0" xml:space="preserve">3483 ms</text>
|
|
64
|
+
<text x="460.8" y="205" fill="#87d787" xml:space="preserve">● ready</text>
|
|
65
|
+
<text x="24.0" y="224" fill="#7c7c7c" xml:space="preserve"> probe: test prompts with a known activity it answered right, and its p95 wait</text>
|
|
66
|
+
<text x="24.0" y="262" fill="#5fafd7" font-weight="700" xml:space="preserve">CLEF FLASH</text>
|
|
67
|
+
<text x="102.0" y="262" fill="#7c7c7c" xml:space="preserve"> · active</text>
|
|
68
|
+
<text x="24.0" y="281" fill="#d0d0d0" xml:space="preserve">Deadline</text>
|
|
69
|
+
<text x="117.6" y="281" fill="#d0d0d0" xml:space="preserve">3000 ms ▾</text>
|
|
70
|
+
<text x="211.2" y="281" fill="#7c7c7c" xml:space="preserve">p95 874 ms in its probe</text>
|
|
71
|
+
<text x="24.0" y="300" fill="#7c7c7c" xml:space="preserve"> past the deadline the turn keeps its model</text>
|
|
72
|
+
<text x="24.0" y="319" fill="#d0d0d0" xml:space="preserve">Sends</text>
|
|
73
|
+
<text x="117.6" y="319" fill="#d0d0d0" xml:space="preserve">prompt + 6 recent turns → api.cloudflare.com</text>
|
|
74
|
+
<text x="24.0" y="338" fill="#d0d0d0" xml:space="preserve">Health</text>
|
|
75
|
+
<text x="117.6" y="338" fill="#d0d0d0" xml:space="preserve">not paused</text>
|
|
76
|
+
<text x="195.6" y="338" fill="#d0d0d0" xml:space="preserve"> · 0 recent failures</text>
|
|
77
|
+
<text x="24.0" y="357" fill="#d0d0d0" xml:space="preserve">Credentials</text>
|
|
78
|
+
<rect x="117.6" y="343" width="62.4" height="18" rx="4" fill="#2e3340"/>
|
|
79
|
+
<text x="117.6" y="357" fill="#d0d0d0" xml:space="preserve">[ Edit ]</text>
|
|
80
|
+
<text x="180.0" y="357" fill="#7c7c7c" xml:space="preserve"> opens /plugin configure</text>
|
|
81
|
+
<text x="24.0" y="395" fill="#5fafd7" font-weight="700" xml:space="preserve">ACROSS SESSIONS · since the last reset</text>
|
|
82
|
+
<text x="24.0" y="414" fill="#d0d0d0" xml:space="preserve">Labelled 83 turns</text>
|
|
83
|
+
<text x="24.0" y="433" fill="#d0d0d0" xml:space="preserve">Agreement classifier vs tools: 78 of 83 turns (94%)</text>
|
|
84
|
+
<text x="24.0" y="452" fill="#d0d0d0" xml:space="preserve">Code/ops/explore classifier vs tools: 78 of 83 turns (94%)</text>
|
|
85
|
+
<text x="24.0" y="471" fill="#d0d0d0" xml:space="preserve">Mismatch code → read 4 · ops → code 1</text>
|
|
86
|
+
<text x="24.0" y="490" fill="#d0d0d0" xml:space="preserve">Activity moves 9 taken · 4 refused</text>
|
|
87
|
+
<text x="24.0" y="509" fill="#d0d0d0" xml:space="preserve">Escalations after a cheaper activity move: 0 in 7 moves</text>
|
|
88
|
+
<text x="24.0" y="547" fill="#87d787" xml:space="preserve">Saved: classifier Clef → Clef Flash. Applies from the next turn. </text>
|
|
89
|
+
<rect x="538.8" y="533" width="62.4" height="18" rx="4" fill="#2e3340"/>
|
|
90
|
+
<text x="538.8" y="547" fill="#d0d0d0" xml:space="preserve">[ Undo ]</text>
|
|
91
|
+
<rect x="24.0" y="552" width="70.2" height="18" rx="4" fill="#2e3340"/>
|
|
92
|
+
<text x="24.0" y="566" fill="#d0d0d0" xml:space="preserve">[ Close ]</text>
|
|
74
93
|
</svg>
|