llm-relay 0.8.2 → 0.8.3

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "llm-relay",
3
- "version": "0.8.2",
3
+ "version": "0.8.3",
4
4
  "description": "Loopback Anthropic-Messages-API proxy that validates and repairs tool-call responses in flight, routing across multi-provider LLM backends.",
5
5
  "type": "module",
6
6
  "engines": {
@@ -106,20 +106,27 @@ are the *first* resort, not the fallback:
106
106
  ```
107
107
  `-high` for analysis and tracing, `-medium` for ordinary recon, `-low` for mechanical sweeps.
108
108
  Other flags: `--add-dir <path>` to scope the workspace, `--json-schema` for structured output,
109
- `--print-timeout` (default 5m), `--mode plan` for analysis-only runs. Spends AGY CLI credits.
110
- *Exhausted when:* the CLI reports credits/quota exhausted or rate-limits.
111
- 2. **Antigravity — Claude, same CLI and credits.** When Flash is not strong enough for the task,
112
- stay on AGY and step up rather than leaving the lane: `--model claude-opus-4-6-thinking` for
109
+ `--print-timeout` (default 5m), `--mode plan` for analysis-only runs.
110
+ *Exhausted when:* the CLI reports the **Gemini** credit balance exhausted, or rate-limits.
111
+ 2. **Antigravity — Claude, same CLI, SEPARATE quota.** AGY meters Gemini and Claude against
112
+ **two independent credit balances**, so exhausting rung 1 does *not* exhaust this rung — that
113
+ is precisely why it is a real fallback and not a duplicate of rung 1. Step up here when Flash
114
+ is not strong enough, or when Gemini credits are gone: `--model claude-opus-4-6-thinking` for
113
115
  hard reasoning, `--model claude-sonnet-4-6` for everything else. (Neither id carries a level
114
- suffix — use the session flag `--effort low|medium|high` if you need to tune them.)
115
- *Exhausted when:* AGY credits are gonei.e. this rung and rung 1 exhaust together.
116
+ suffix — use the session flag `--effort low|medium|high` to tune them.)
117
+ *Exhausted when:* the **Claude** balance is exhausted independently of rung 1, in either
118
+ direction.
116
119
  3. **Codex — Sol, then Terra, then Luna.** Spends the ChatGPT subscription:
117
120
  ```bash
118
- codex exec --model gpt-5.6-sol "<task>"
121
+ codex exec --model gpt-5.6-sol -c model_reasoning_effort="medium" "<task>"
119
122
  ```
120
- Walk `gpt-5.6-sol` → `gpt-5.6-terra` → `gpt-5.6-luna` in that order. Set reasoning to suit with
121
- `-c model_reasoning_effort="high|medium|low"` (the config default is `high`). `codex exec review`
122
- runs a repo review. *Exhausted when:* it reports usage-limit errors.
123
+ Walk `gpt-5.6-sol` → `gpt-5.6-terra` → `gpt-5.6-luna` in that order. Reasoning level is a
124
+ config override, not a flag Codex has no `--effort`: `-c model_reasoning_effort=` accepts
125
+ `minimal|low|medium|high|xhigh` (the config default in `~/.codex/config.toml` is `high`;
126
+ `plan_mode_reasoning_effort` sets it separately for plan mode). ⚠ Codex's own guidance is that
127
+ high effort burns subscription rate limits fast — match the level to the task rather than
128
+ leaving it at `high` for mechanical work. `codex exec review` runs a repo review.
129
+ *Exhausted when:* it reports usage-limit errors.
123
130
  4. **Relay pools — free API-key capacity, benchmark order.** `@relay: pool/coding` (or the tier
124
131
  mapping in `routing.subagents` when offload is on). Ordering *inside* a pool is by synced
125
132
  benchmark strength, not config order — see "Reordering dispatch" below. *Exhausted when:* the
@@ -139,6 +146,9 @@ Rules for walking it:
139
146
  source) exactly like relay-offloaded output. Do NOT wrap them in a bare one-shot HTTP helper.
140
147
  - A **refusal or a wrong answer is not a transport failure** — do not walk the ladder to shop for
141
148
  a more compliant model. Only availability failures (errors, quota, rate limits) advance a rung.
149
+ - **The rungs draw on five independent buckets**, so exhausting one never implies the next is
150
+ gone: AGY-Gemini, AGY-Claude (separate balances despite one CLI), ChatGPT, provider API keys,
151
+ Anthropic primary. Re-check the rung you skipped on the next dispatch — a reset refills it.
142
152
  - Interactive-only quotas (e.g. an IDE-bound plan with no CLI) are unreachable by any dispatcher;
143
153
  don't try to MITM them into the ladder.
144
154