agentfences 0.4.0 → 0.6.0

package/README.md

@@ -61,11 +61,11 @@ The server is authoritative for limits and sees spend across processes. If it ca
 
 ## Live control (from 0.4.0)
 
-From version 0.4.0, which isn't on npm yet: in cloud mode a heartbeat (every 15 seconds, `init({ heartbeatS })`) lets whoever is on call act on a running agent from the dashboard:
+In cloud mode a heartbeat (every 15 seconds, `init({ heartbeatS })`) lets whoever is on call act on a running agent from the dashboard:
 
-- **Stop:** the next `checkpoint()` returns `breachType: "stopped_by_user"`, so the agent wraps up gracefully.
+- **Stop:** the next `checkpoint()` returns `breachType: "stopped_by_user"`, so the agent wraps up gracefully. If the run doesn't reach a checkpoint within `stopGraceS` (default 30) seconds, say it's stuck in a tool, the governed call rejects with `FencesStop` and the run's `signal` aborts (from 0.5.0). JavaScript can't stop running code, so pass `getActiveRun()?.signal` to `fetch` and other cancellable work for a stuck run to really stop. `init({ stopGraceS: null })` turns this off.
 - **Pause and resume:** a paused run waits inside its next `checkpoint()` until it's resumed; after `pauseTimeoutS` (default one hour) it returns `breachType: "paused"`.
-- **Limits** changed in the dashboard apply to the run immediately. **Quarantine** makes the governed call throw `AgentQuarantined` before any agent code runs.
+- **Limits** changed in the dashboard apply to the run immediately. **Quarantine** makes the governed call throw `AgentQuarantined` before any agent code runs; runs already going hold at their next checkpoint, and their guarded tools are blocked.
 
 An agent can ask a person before doing something risky:
 
@@ -78,6 +78,35 @@ if (!approval.granted) return `I didn't issue the refund: ${approval.note}`;
 
 An approved amount raises the run's budget. It never hangs or throws: in local mode, outside a run, or on a server without approvals it's denied right away, and with no answer it's denied after `timeoutS`. The heartbeat's timer never keeps your process alive on its own.
 
+**Waiting at a limit** (from 0.6.0): with `init({ onBreach: "hold" })` (or `governed(fn, { onBreach: "hold" })`), a limit the server says is crossed makes `checkpoint()` wait instead of returning the breach, so whoever is on call can raise it from the dashboard and the agent carries on. A guarded tool denied for budget waits the same way. A stop ends the wait; after `pauseTimeoutS` the agent gets the breach it was held at. Cloud only. Don't hold an agent a person is waiting on.
+
+**Containment hooks** (from 0.5.0) run in your process when a stop or quarantine arrives, to contain what Fences can't reach, such as a credential the agent holds:
+
+```ts
+init({ apiKey: "fc_...", onQuarantine: async (event) => vault.revoke(`agent/${event.agentName}`), onStop: (event) => { ... } });
+```
+
+`onStop` runs once per run, and `onQuarantine` once per quarantine however many runs it reaches. Each gets `{ type, runId, agentName, id, by, reason }`. Fences records whether it worked, threw (and why) or ran past 30 seconds. A process that's about to exit waits for its hooks first; in serverless handlers, `await flush()` does the same. The SDK also acknowledges every dashboard command it receives, so the dashboard can tell "the agent has it" from "the agent hasn't acknowledged".
+
+## Guarded tools (from 0.5.0)
+
+For actions with consequences (refunds, payments, writes to production), guard the tool, and it asks Fences **before** it runs:
+
+```ts
+import { tool, ToolBlocked } from "agentfences";
+
+const issueRefund = tool(refund, { costUsd: (orderId: string, amount: number) => amount, approve: true });
+const deploy = tool(deployImpl, { guard: true, timeoutS: 30 });
+```
+
+- The tool runs only if its run isn't stopped, paused, over a limit or quarantined. Otherwise it throws `ToolBlocked` (with `reason` and `breachType`) and its code never runs.
+- `costUsd` (a number, or a function of the tool's arguments) is **reserved** before the call and charged after, so parallel calls can't overspend the budget together. A call that throws is released uncharged; one that times out is charged, because it may have happened.
+- `approve: true` asks a person on the dashboard before each call. The dashboard can also require approval for a tool, and the SDK then asks for it.
+- **Guards fail closed:** if Fences can't be reached, or doesn't support guarded tools, the tool is blocked. In local mode the same rules apply in-process, and `approve` is always denied.
+- `timeoutS` works on any tool: past it, the call rejects with a `TimeoutError`. The tool's own code carries on unless it uses `getActiveRun()?.signal`.
+
+A guarded or timed tool always returns a promise. What each part guarantees: [ENFORCEMENT.md](../ENFORCEMENT.md).
+
 ## Not yet in the TypeScript SDK
 
-The Python SDK also records OpenAI/Anthropic calls automatically (`instrument`) and integrates with LangGraph and the OpenAI Agents SDK. Everything here follows the same server protocol ([PROTOCOL.md](../PROTOCOL.md)).
+The Python SDK also records OpenAI/Anthropic calls automatically (`instrument`) and integrates with LangGraph and the OpenAI Agents SDK. Those are also how it checks a model call against the budget **before** it's sent, so the TypeScript SDK doesn't do that yet: a model call is checked afterwards, by `checkpoint()`, and a run can go over its budget by one call. Everything here follows the same server protocol ([PROTOCOL.md](../PROTOCOL.md)).

package/dist/client.d.ts

@@ -9,8 +9,10 @@ export declare class FencesClient {
     logDecision(runId: string, body: Record<string, unknown>): Promise<Reply>;
     endRun(runId: string, body: Record<string, unknown>): Promise<Reply>;
     logSpans(runId: string, spans: unknown[]): Promise<Reply>;
-    /** Report live runs; the reply may carry commands for them. */
-    heartbeat(runs: unknown[]): Promise<Reply>;
+    /** Report live runs and acknowledge commands; the reply may carry commands for them. */
+    heartbeat(runs: unknown[], acks?: unknown[]): Promise<Reply>;
+    /** Check a guarded tool call before it runs ({ phase: "check" }), or settle it after ({ phase: "settle" }). */
+    guard(runId: string, body: Record<string, unknown>): Promise<Reply>;
     requestApproval(runId: string, body: Record<string, unknown>): Promise<Reply>;
     /**
      * optional: an endpoint older servers may not have. A missing route returns

package/dist/client.js

@@ -17,8 +17,12 @@ export class FencesClient {
     logDecision(runId, body) { return this.post(`/api/runs/${runId}/decisions`, body); }
     endRun(runId, body) { return this.post(`/api/runs/${runId}/end`, body); }
     logSpans(runId, spans) { return this.post(`/api/runs/${runId}/spans`, { spans }, true); }
-    /** Report live runs; the reply may carry commands for them. */
-    heartbeat(runs) { return this.post("/api/heartbeat", { runs }, true); }
+    /** Report live runs and acknowledge commands; the reply may carry commands for them. */
+    heartbeat(runs, acks = []) {
+        return this.post("/api/heartbeat", acks.length ? { runs, acks } : { runs }, true);
+    }
+    /** Check a guarded tool call before it runs ({ phase: "check" }), or settle it after ({ phase: "settle" }). */
+    guard(runId, body) { return this.post(`/api/runs/${runId}/guard`, body, true); }
     requestApproval(runId, body) { return this.post(`/api/runs/${runId}/approvals`, body, true); }
     /**
      * optional: an endpoint older servers may not have. A missing route returns

package/dist/control.d.ts

@@ -8,23 +8,75 @@ export interface Approval {
     note?: string | null;
     /** The amount approved, if one was asked for. */
     amountUsd?: number | null;
+    approvalId?: string | null;
 }
+/** What onStop and onQuarantine receive. */
+export interface ControlEvent {
+    type: "stop" | "quarantine";
+    runId: string;
+    agentName: string;
+    /** The command's id, if the server sent one. */
+    id: string | null;
+    /** Who pressed the button, as the dashboard reports it. */
+    by: string | null;
+    reason: string | null;
+}
+export type Hook = (event: ControlEvent) => unknown;
 /** Live-control state a run carries. */
 export interface Control {
     stopped: boolean;
+    stoppedAt: number;
+    /** The agent got its stop from a checkpoint (or a blocked tool): it's never cancelled. */
+    stopSeen: boolean;
+    cancelled: boolean;
+    /** Set by governed(): halts the call when a stop goes unseen past stopGraceS. */
+    onCancel: (() => void) | null;
     paused: boolean;
     pauseExpired: boolean;
+    quarantined: boolean;
+    /** While waiting at a limit: "breach" or "budget". */
+    held: "breach" | "budget" | null;
     /** approval id -> the answer, or null while waiting */
     approvals: Map<string, Approval | null>;
     awaiting: number;
+    /** command ids already acknowledged */
+    acked: Set<string>;
 }
 export declare const newControl: () => Control;
 export declare let pauseTimeoutMs: number;
-export declare function configure(c: FencesClient | null, heartbeatS: number, pauseTimeoutS: number): void;
+export declare const supported: {
+    heartbeat: boolean;
+    approvals: boolean;
+    guard: boolean;
+};
+export interface ControlOptions {
+    heartbeatS: number;
+    pauseTimeoutS: number;
+    stopGraceS: number | null;
+    onStop?: Hook | null;
+    onQuarantine?: Hook | null;
+}
+export declare function configure(c: FencesClient | null, o: ControlOptions): void;
 export declare function register(run: Run): void;
 export declare function unregister(run: Run): void;
-/** Apply the commands addressed to this run (from a heartbeat or a checkpoint reply). Each is safe to apply twice. */
+export declare function unsupported(kind: keyof typeof supported, what: string, consequence: string): void;
+/** Apply the commands addressed to this run (from a heartbeat or a checkpoint reply), and acknowledge them. Each is safe to apply twice. */
 export declare function apply(run: Run, commands: Reply[] | undefined): void;
+/**
+ * Wait for running hooks, then send the acknowledgements still waiting. flush() calls it, and
+ * it runs before the process exits, so a script that ends right after a stop still finishes
+ * its containment, and says so.
+ */
+export declare function drain(timeoutMs?: number): Promise<void>;
+/** Breaches a person can lift by raising a limit, so onBreach "hold" waits at them. */
+export declare const HOLDABLE: Set<string>;
+export declare const BUDGET_BREACHES: Set<string>;
+/** Whether this run waits at a limit: onBreach "hold", in cloud mode (someone can raise it), and not stopped. */
+export declare const holds: (run: Run) => boolean;
+/** Pause the run at a limit: "breach" (a checkpoint breached) or "budget" (a call refused for budget). */
+export declare function startHold(run: Run, kind: "breach" | "budget"): void;
+/** After waiting: "released" (an operator raised the limit), "stopped", or "timeout". */
+export declare function endHold(run: Run): "released" | "stopped" | "timeout";
 /** Hold the agent at its checkpoint while its run is paused, up to pauseTimeoutS. */
 export declare function waitIfPaused(run: Run): Promise<void>;
 /**

package/dist/control.js

@@ -1,24 +1,39 @@
 /**
  * Live control from the Fences dashboard: a heartbeat that reports live runs and brings back
- * commands (stop, pause, resume, limits, approval answers), pausing at checkpoints, and
- * approval requests. Cloud mode only; a server without these endpoints gets one warning and
- * runs carry on as before. Same behaviour as the Python SDK (PROTOCOL.md, "Live control").
+ * commands (stop, pause, resume, quarantine, limits, approval answers) and acknowledges them,
+ * containment hooks, pausing at checkpoints, cancelling a run stuck after a stop, and approval
+ * requests. Cloud mode only; a server without these endpoints gets one warning and runs carry
+ * on as before. Same behaviour as the Python SDK (PROTOCOL.md, "Live control").
  */
 import { randomUUID } from "node:crypto";
-const FAST_MS = 2000; // heartbeat interval while a run is paused or waiting for an approval
-export const newControl = () => ({ stopped: false, paused: false, pauseExpired: false, approvals: new Map(), awaiting: 0 });
+/** Heartbeat statuses whose acks go again with the next heartbeat: rate limited, or a server error. */
+const retryable = (status) => status === undefined || status === 429 || status >= 500;
+const FAST_MS = 2000; // heartbeat interval while a run is paused, waiting for an approval, or stopping
+const HOOK_TIMEOUT_MS = 30_000; // a hook still running after this is reported as timed out
+export const newControl = () => ({
+    stopped: false, stoppedAt: 0, stopSeen: false, cancelled: false, onCancel: null, paused: false, pauseExpired: false,
+    quarantined: false, held: null, approvals: new Map(), awaiting: 0, acked: new Set(),
+});
 const live = new Map(); // run id -> runs in progress
 let client = null;
 let intervalMs = 15_000;
 export let pauseTimeoutMs = 3_600_000;
-const supported = { heartbeat: true, approvals: true };
+let stopGraceMs = 30_000;
+const hooks = { stop: null, quarantine: null };
+export const supported = { heartbeat: true, approvals: true, guard: true };
 let timer = null;
 let beating = false;
-export function configure(c, heartbeatS, pauseTimeoutS) {
+let acks = []; // acknowledgements waiting for the next heartbeat
+const hooked = new Set(); // quarantine ids whose hook has run in this process
+const runningHooks = new Set();
+export function configure(c, o) {
     client = c;
-    intervalMs = heartbeatS * 1000;
-    pauseTimeoutMs = pauseTimeoutS * 1000;
-    supported.heartbeat = supported.approvals = true;
+    intervalMs = o.heartbeatS * 1000;
+    pauseTimeoutMs = o.pauseTimeoutS * 1000;
+    stopGraceMs = o.stopGraceS === null ? null : o.stopGraceS * 1000;
+    hooks.stop = o.onStop ?? null;
+    hooks.quarantine = o.onQuarantine ?? null;
+    supported.heartbeat = supported.approvals = supported.guard = true;
     schedule(0); // a new client or interval takes effect now, not after the old wait
 }
 export function register(run) {
@@ -29,7 +44,7 @@ export function register(run) {
 export function unregister(run) {
     live.delete(run.runId);
 }
-function unsupported(kind, what, consequence) {
+export function unsupported(kind, what, consequence) {
     if (!supported[kind])
         return;
     supported[kind] = false;
@@ -37,22 +52,32 @@ function unsupported(kind, what, consequence) {
 }
 // ── Commands ──────────────────────────────────────────────────────────────────
 const LIMITS = { budget_usd: "budgetUsd", max_iterations: "maxIterations", max_duration_ms: "maxDurationMs", max_tokens: "maxTokens" };
-/** Apply the commands addressed to this run (from a heartbeat or a checkpoint reply). Each is safe to apply twice. */
+/** Apply the commands addressed to this run (from a heartbeat or a checkpoint reply), and acknowledge them. Each is safe to apply twice. */
 export function apply(run, commands) {
-    for (const c of commands ?? []) {
+    // Limits first: a resume in the same reply may release a call held for budget, which re-checks against them at once
+    for (const c of [...(commands ?? [])].sort((a, b) => Number(a.type !== "limits") - Number(b.type !== "limits"))) {
         if (c.run_id !== undefined && c.run_id !== run.runId)
             continue;
         const ctl = run.control;
         if (c.type === "stop") {
-            ctl.stopped = true;
-            ctl.paused = false;
+            if (!ctl.stopped) {
+                ctl.stopped = true;
+                ctl.stoppedAt = Date.now();
+                schedule(0); // watch for the agent to see it, or cancel it
+                hook("stop", run, c); // once per run
+            }
+            ctl.paused = ctl.quarantined = false;
         }
-        else if (c.type === "pause") {
+        else if (c.type === "pause" || c.type === "quarantine") { // a quarantined agent's runs hold at their next checkpoint
             ctl.paused = true;
             schedule(0);
+            if (c.type === "quarantine") {
+                ctl.quarantined = true; // guarded tools are blocked here too, even if the server can't be reached
+                hook("quarantine", run, c);
+            }
         }
         else if (c.type === "resume") {
-            ctl.paused = false;
+            ctl.paused = ctl.quarantined = false; // releasing a quarantine resumes its runs
         }
         else if (c.type === "limits") {
             for (const [wire, field] of Object.entries(LIMITS)) {
@@ -60,44 +85,174 @@ export function apply(run, commands) {
                     run[field] = c[wire]; // eslint-disable-line @typescript-eslint/no-explicit-any
             }
         }
-        else if (c.type === "approval" && ctl.approvals.has(c.approval_id)) {
-            ctl.approvals.set(c.approval_id, { granted: !!c.granted, by: c.by ?? null, note: c.note ?? null, amountUsd: c.amount_usd ?? null });
+        else if (c.type === "approval") {
+            if (ctl.approvals.has(c.approval_id)) {
+                ctl.approvals.set(c.approval_id, { granted: !!c.granted, by: c.by ?? null, note: c.note ?? null, amountUsd: c.amount_usd ?? null });
+            }
+        }
+        else {
+            continue; // unknown: ignored, and not acknowledged
+        }
+        if (c.id && !ctl.acked.has(c.id)) {
+            ctl.acked.add(c.id);
+            ack({ run_id: run.runId, id: c.id, type: c.type, received_at: Date.now() / 1000 });
         }
     }
 }
-const busy = () => [...live.values()].some((r) => r.control.paused || r.control.awaiting > 0);
-const nextDelay = () => (busy() ? Math.min(FAST_MS, intervalMs) : intervalMs); // faster while busy, never slower
+// ── Acknowledgements and containment hooks ────────────────────────────────────
+function ack(entry) {
+    acks.push(entry);
+    schedule(0); // send it now, not at the next interval
+}
+function hook(kind, run, c) {
+    const fn = hooks[kind];
+    if (!fn)
+        return;
+    if (kind === "quarantine") {
+        const key = c.id ?? `run:${run.runId}`; // every server that sends quarantine gives it an id
+        if (hooked.has(key))
+            return; // once per process per quarantine
+        hooked.add(key);
+    }
+    const event = { type: kind, runId: run.runId, agentName: run.agentName, id: c.id ?? null, by: c.by ?? null, reason: c.reason ?? null };
+    const p = runHook(fn, event).finally(() => runningHooks.delete(p));
+    runningHooks.add(p);
+}
+async function runHook(fn, event) {
+    const { errorText } = await import("./events.js");
+    let result = "ok", detail = null;
+    try {
+        const timedOut = Symbol("timeout");
+        const out = await Promise.race([
+            Promise.resolve().then(() => fn(event)),
+            new Promise((ok) => setTimeout(ok, HOOK_TIMEOUT_MS, timedOut).unref()), // ponytail: a hung hook can't be stopped; it's reported and left running
+        ]);
+        if (out === timedOut)
+            result = "timeout";
+    }
+    catch (e) {
+        [result, detail] = ["failed", errorText(e).slice(0, 300)];
+    }
+    if (result !== "ok")
+        console.warn(`agentfences: the on${event.type === "stop" ? "Stop" : "Quarantine"} hook ${result === "timeout" ? "timed out" : `failed: ${detail}`}`);
+    if (event.id) {
+        ack({ run_id: event.runId, id: event.id, type: event.type, hook: result, ...(detail ? { detail } : {}), finished_at: Date.now() / 1000 });
+    }
+}
+/**
+ * Wait for running hooks, then send the acknowledgements still waiting. flush() calls it, and
+ * it runs before the process exits, so a script that ends right after a stop still finishes
+ * its containment, and says so.
+ */
+export async function drain(timeoutMs = HOOK_TIMEOUT_MS) {
+    if (runningHooks.size) {
+        await Promise.race([Promise.allSettled([...runningHooks]), new Promise((ok) => setTimeout(ok, timeoutMs).unref())]);
+    }
+    await sendAcks();
+}
+async function sendAcks() {
+    if (!acks.length || !client || !supported.heartbeat)
+        return;
+    const batch = acks;
+    acks = [];
+    const resp = await client.heartbeat([], batch).catch(() => ({ network_error: "heartbeat failed" }));
+    if (resp.network_error || (resp.ok === false && retryable(resp.status)))
+        acks = [...batch, ...acks];
+}
+// Node exits once nothing keeps it busy: beforeExit lets acks queued by a finished hook still go out.
+// One try per batch: a server that's gone mustn't keep the process alive by failing and requeueing forever.
+let triedAtExit = false;
+if (typeof process?.on === "function") { // edge runtimes have no process events: flush() still drains there
+    process.on("beforeExit", () => {
+        if (triedAtExit || !acks.length || !client)
+            return;
+        triedAtExit = true;
+        void sendAcks();
+    });
+}
+// ── Heartbeat ─────────────────────────────────────────────────────────────────
+const unseenStop = (r) => r.control.stopped && !r.control.stopSeen && !r.control.cancelled && r.control.onCancel !== null;
+const busy = () => [...live.values()].some((r) => r.control.paused || r.control.awaiting > 0 || unseenStop(r));
+const nextDelay = () => (busy() ? Math.min(FAST_MS, intervalMs, stopGraceMs ?? FAST_MS) : intervalMs); // faster while busy, never slower
 function schedule(delayMs) {
     if (timer)
         clearTimeout(timer);
     timer = null;
-    if (!client || !supported.heartbeat || !live.size)
+    if (!client || !supported.heartbeat || !(live.size || acks.length))
         return;
     timer = setTimeout(beat, delayMs);
     timer.unref(); // the heartbeat never keeps the process alive on its own
 }
+/** Halt governed calls that haven't reached a checkpoint within stopGraceS of a stop. */
+function cancelOverdue() {
+    if (stopGraceMs === null)
+        return;
+    for (const r of live.values()) {
+        if (unseenStop(r) && Date.now() - r.control.stoppedAt >= stopGraceMs) {
+            r.control.cancelled = true;
+            r.control.onCancel();
+        }
+    }
+}
 async function beat() {
     timer = null;
-    if (beating || !client || !live.size)
+    cancelOverdue();
+    if (beating || !client || !(live.size || acks.length))
         return schedule(nextDelay());
     beating = true;
+    const runs = [...live.values()], batch = acks;
+    acks = [];
     try {
-        const runs = [...live.values()];
         const resp = await client.heartbeat(runs.map((r) => ({ run_id: r.runId, iterations: r.iterations, spent_usd: r.costUsd,
-            tokens_used: r.tokensUsed, paused: r.control.paused })));
-        if (resp.unsupported) {
+            tokens_used: r.tokensUsed, paused: r.control.paused, stopped: r.control.stopped,
+            ...(r.control.held ? { held: r.control.held } : {}) })), batch);
+        if (resp.network_error || (resp.ok === false && !resp.unsupported)) {
+            if (resp.network_error || retryable(resp.status))
+                acks = [...batch, ...acks]; // at least once; any other 4xx won't get better
+        }
+        else if (resp.unsupported) {
             unsupported("heartbeat", "the heartbeat", "a stop from the dashboard applies at the next checkpoint and pause isn't available");
             return;
         }
-        for (const run of runs)
-            apply(run, resp.commands?.filter((c) => c.run_id === run.runId));
+        else {
+            for (const run of runs)
+                apply(run, resp.commands?.filter((c) => c.run_id === run.runId));
+        }
+    }
+    catch {
+        acks = [...batch, ...acks]; // a failed heartbeat is retried next time
     }
-    catch { /* a failed heartbeat is retried next time */ }
     finally {
         beating = false;
     }
     schedule(nextDelay());
 }
+// ── Waiting at a limit ────────────────────────────────────────────────────────
+/** Breaches a person can lift by raising a limit, so onBreach "hold" waits at them. */
+export const HOLDABLE = new Set(["budget_exceeded", "iteration_limit", "time_limit", "token_limit", "key_daily_budget",
+    "key_monthly_budget", "limit_reached"]);
+export const BUDGET_BREACHES = new Set(["budget_exceeded", "key_daily_budget", "key_monthly_budget"]);
+/** Whether this run waits at a limit: onBreach "hold", in cloud mode (someone can raise it), and not stopped. */
+export const holds = (run) => run.onBreach === "hold" && client !== null && !run.control.stopped;
+/** Pause the run at a limit: "breach" (a checkpoint breached) or "budget" (a call refused for budget). */
+export function startHold(run, kind) {
+    run.control.held = kind;
+    if (!run.control.paused) {
+        run.control.paused = true;
+        schedule(0);
+    }
+}
+/** After waiting: "released" (an operator raised the limit), "stopped", or "timeout". */
+export function endHold(run) {
+    run.control.held = null;
+    if (run.control.stopped)
+        return "stopped";
+    if (run.control.pauseExpired) {
+        run.control.pauseExpired = false; // the run ends with the limit it was held at, not "paused"
+        return "timeout";
+    }
+    return "released";
+}
 // ── Pausing ───────────────────────────────────────────────────────────────────
 /** Hold the agent at its checkpoint while its run is paused, up to pauseTimeoutS. */
 export async function waitIfPaused(run) {
@@ -150,6 +305,7 @@ export async function requestApproval(reason, options = {}) {
     }
     run.control.awaiting -= 1;
     const answer = run.control.approvals.get(approvalId) ?? { granted: false, note: "No answer before the timeout" };
+    answer.approvalId = approvalId;
     run.control.approvals.delete(approvalId);
     if (answer.granted && answer.amountUsd && run.budgetUsd !== null)
         run.budgetUsd += answer.amountUsd; // an unlimited run stays unlimited

package/dist/core.d.ts

@@ -58,6 +58,19 @@ export declare class Run {
     warned: boolean;
     /** Live control from the dashboard (see control.ts). */
     readonly control: control.Control;
+    /** Held by guarded tools that are running. */
+    reservedUsd: number;
+    /** "hold": wait at a limit for someone to raise it (see InitOptions.onBreach). */
+    onBreach: "hold" | null;
+    private readonly abort;
+    /**
+     * Aborts when Fences halts the run after a stop it didn't reach a checkpoint for (see
+     * stopGraceS). Pass it to fetch and other cancellable work so a stuck run really stops:
+     *     await fetch(url, { signal: getActiveRun()?.signal });
+     */
+    get signal(): AbortSignal;
+    /** @internal */
+    _abort(reason: unknown): void;
     constructor(agentName: string, budgetUsd: number | null, maxIterations: number, maxDurationMs: number, maxTokens: number, context: Record<string, string>);
     get durationMs(): number;
 }
@@ -84,11 +97,34 @@ export interface InitOptions {
     heartbeatS?: number;
     /** How long a paused run waits at its checkpoint before stopping with breach "paused". Default 3600. */
     pauseTimeoutS?: number;
+    /**
+     * If a run doesn't reach a checkpoint within this many seconds of a dashboard stop (say, it's
+     * stuck in a tool), the governed call rejects with FencesStop and the run's signal aborts.
+     * Default 30; null never does.
+     */
+    stopGraceS?: number | null;
+    /**
+     * Run in the agent's process when a stop arrives from the dashboard (once per run), to
+     * contain what Fences can't reach, e.g. revoke a credential the agent holds. Whether it
+     * worked, threw or ran past 30 seconds is reported to Fences.
+     */
+    onStop?: control.Hook;
+    /** The same, when the agent is quarantined (once per quarantine, however many runs it reaches). */
+    onQuarantine?: control.Hook;
+    /**
+     * "hold" makes runs wait at a limit instead of ending: when the server says a limit is crossed,
+     * checkpoint() waits (as if paused) until someone raises it and resumes the run, then returns ok
+     * and the agent carries on. A guarded tool denied for budget waits the same way. A stop ends the
+     * wait, and after pauseTimeoutS the breach is returned as usual. Cloud only; override per agent in governed().
+     */
+    onBreach?: "hold" | null;
 }
 /** Call once at startup, before any governed function runs. */
 export declare function init(options?: InitOptions): void;
 /** @internal For tests: point the SDK at a fake server client. */
 export declare function _setClient(c: FencesClient | null): void;
+/** @internal */
+export declare const _client: () => FencesClient | null;
 /**
  * Make each call of fn a governed run with these limits:
  *
@@ -100,6 +136,7 @@ export declare function _setClient(c: FencesClient | null): void;
  */
 export declare function governed<A extends unknown[], R>(fn: (...args: A) => R | Promise<R>, options?: Limits & {
     name?: string;
+    onBreach?: "hold" | null;
 }): (...args: A) => Promise<Awaited<R>>;
 export interface Extra {
     /** Extra spend for this step in USD, e.g. a paid tool call. Without a response, the step's whole cost. */
@@ -119,7 +156,12 @@ export interface Extra {
  * Never throws for a breach. Outside a governed run it does nothing.
  */
 export declare function checkpoint(response?: unknown, extra?: Extra): Promise<CheckpointResult>;
-/** Wait up to timeoutMs for queued decisions and spans to reach the server. Call before a serverless handler returns. */
+/** @internal The breach the run is in by local rules, if any. */
+export declare function localBreach(run: Run): string | null;
+/**
+ * Wait up to timeoutMs for queued decisions and spans to reach the server, and for onStop and
+ * onQuarantine hooks to finish. Call before a serverless handler returns.
+ */
 export declare function flush(timeoutMs?: number): Promise<void>;
 /** Record the agent's reasoning at this step. Does nothing outside a governed run. */
 export declare function logDecision(reasoning: string, action?: string | null): void;

package/dist/core.js

@@ -60,6 +60,19 @@ export class Run {
     warned = false;
     /** Live control from the dashboard (see control.ts). */
     control = control.newControl();
+    /** Held by guarded tools that are running. */
+    reservedUsd = 0;
+    /** "hold": wait at a limit for someone to raise it (see InitOptions.onBreach). */
+    onBreach = null;
+    abort = new AbortController();
+    /**
+     * Aborts when Fences halts the run after a stop it didn't reach a checkpoint for (see
+     * stopGraceS). Pass it to fetch and other cancellable work so a stuck run really stops:
+     *     await fetch(url, { signal: getActiveRun()?.signal });
+     */
+    get signal() { return this.abort.signal; }
+    /** @internal */
+    _abort(reason) { this.abort.abort(reason); }
     constructor(agentName, budgetUsd, maxIterations, maxDurationMs, maxTokens, context) {
         this.agentName = agentName;
         this.budgetUsd = budgetUsd;
@@ -78,12 +91,21 @@ export function getActiveRun() {
 let client = null;
 let localOnly = false;
 let failClosed = false;
+let defaultOnBreach = null;
+function checkOnBreach(value) {
+    if (value === undefined || value === null)
+        return null;
+    if (value !== "hold")
+        throw new TypeError(`onBreach must be "hold" or null, not ${JSON.stringify(value)}`);
+    return value;
+}
 /** Call once at startup, before any governed function runs. */
 export function init(options = {}) {
     setCustomPrices(options.prices);
     events.configure(options.environment, options.release, options.redact);
     localOnly = !!options.localOnly;
     failClosed = !!options.failClosed;
+    defaultOnBreach = checkOnBreach(options.onBreach);
     if (localOnly) {
         client = null;
     }
@@ -93,10 +115,16 @@ export function init(options = {}) {
     else {
         client = new FencesClient(options.apiKey, options.endpoint ?? "http://localhost:8000");
     }
-    control.configure(client, options.heartbeatS ?? 15, options.pauseTimeoutS ?? 3600);
+    control.configure(client, { heartbeatS: options.heartbeatS ?? 15, pauseTimeoutS: options.pauseTimeoutS ?? 3600,
+        stopGraceS: options.stopGraceS === undefined ? 30 : options.stopGraceS, onStop: options.onStop, onQuarantine: options.onQuarantine });
 }
 /** @internal For tests: point the SDK at a fake server client. */
-export function _setClient(c) { client = c; control.configure(c, 15, 3600); }
+export function _setClient(c) {
+    client = c;
+    control.configure(c, { heartbeatS: 15, pauseTimeoutS: 3600, stopGraceS: 30 });
+}
+/** @internal */
+export const _client = () => client;
 function requireInit() {
     if (!localOnly && !client) {
         throw new Error("Call agentfences.init() before using Fences. For local usage: init({ localOnly: true })");
@@ -120,19 +148,31 @@ function warnUnreachable(run, err) {
  */
 export function governed(fn, options = {}) {
     const name = options.name ?? (fn.name || "agent");
+    checkOnBreach(options.onBreach);
     return async (...args) => {
         requireInit();
         const run = await startRun(name, options);
+        run.onBreach = checkOnBreach(options.onBreach) ?? defaultOnBreach;
+        // A stop the agent doesn't reach a checkpoint for within stopGraceS halts the call here
+        const halted = new Promise((_, reject) => {
+            run.control.onCancel = () => {
+                const stop = new FencesStop(finalResult(run));
+                run._abort(stop);
+                reject(stop);
+            };
+        });
         control.register(run);
         let error, failed = false;
         try {
-            return await store.run(run, () => fn(...args));
+            // ponytail: JS can't stop running code; the agent's own work goes on unless it uses run.signal
+            return await Promise.race([store.run(run, () => fn(...args)), halted]);
         }
         catch (e) {
             [error, failed] = [e, true];
             throw e;
         }
         finally {
+            run.control.onCancel = null; // first, so a late cancel can't land after the call is over
             await endRun(run, ...outcome(run, failed, error));
         }
     };
@@ -141,7 +181,7 @@ function outcome(run, failed, error) {
     if (!failed)
         return [run.lastBreach ? "breached" : "success", null];
     if (error instanceof FencesStop)
-        return ["breached", null]; // a framework integration halted the agent
+        return ["breached", null]; // halted after a stop it missed (stopGraceS)
     run.exception = events.exceptionInfo(error);
     const e = run.exception;
     return ["error", e.message ? `${e.type}: ${e.message}` : e.type];
@@ -193,6 +233,8 @@ async function endRun(run, status, error) {
     const body = { status, error: sent?.error ?? null };
     if (sent?.exception)
         body.exception = sent.exception;
+    if (status === "breached" && run.lastBreach)
+        body.breach = run.lastBreach; // matters for breaches the SDK decided
     await client.endRun(run.runId, body);
 }
 /**
@@ -222,13 +264,25 @@ export async function checkpoint(response, extra = {}) {
         cost_delta_usd: stepCost, tokens_used: stepTokens, iterations: run.iterations, duration_ms: run.durationMs
     }) : null;
     const result = decide(run, resp);
+    // onBreach "hold": wait here for someone to raise the limit. Only a breach the server decided: an unreachable one can't be raised
+    if (result.breachType && control.HOLDABLE.has(result.breachType) && control.holds(run) && resp && !resp.network_error) {
+        control.startHold(run, "breach");
+        await control.waitIfPaused(run);
+        const outcome = control.endHold(run);
+        if (outcome === "released") { // an operator raised the limit and resumed the run
+            run.lastBreach = null;
+            return okResult(run.costUsd);
+        }
+        return outcome === "stopped" ? finalResult(run) : result; // timed out: the limit it was held at
+    }
     if (run.control.paused && !result.breached) { // paused from the dashboard: wait here until resumed
         await control.waitIfPaused(run);
         return finalResult(run);
     }
     return result;
 }
-function localBreach(run) {
+/** @internal The breach the run is in by local rules, if any. */
+export function localBreach(run) {
     // Limits trip only once exceeded, same rule as the server; round away float drift (0.02*5 != 0.10)
     if (run.budgetUsd !== null && Math.round(run.costUsd * 1e9) / 1e9 > run.budgetUsd)
         return "budget_exceeded";
@@ -267,8 +321,10 @@ function decide(run, resp) {
     return finalResult(run);
 }
 function finalResult(run) {
-    if (run.control.stopped)
-        run.lastBreach = "stopped_by_user"; // a stop from the dashboard sticks, whatever a later reply says
+    if (run.control.stopped) { // a stop from the dashboard sticks, whatever a later reply says
+        run.lastBreach = "stopped_by_user";
+        run.control.stopSeen = true;
+    }
     else if (run.control.pauseExpired)
         run.lastBreach = "paused";
     return run.lastBreach ? breachResult(run.lastBreach, run) : okResult(run.costUsd);
@@ -307,11 +363,15 @@ async function drain() {
         catch { /* never let delivery break the agent */ }
     }
 }
-/** Wait up to timeoutMs for queued decisions and spans to reach the server. Call before a serverless handler returns. */
+/**
+ * Wait up to timeoutMs for queued decisions and spans to reach the server, and for onStop and
+ * onQuarantine hooks to finish. Call before a serverless handler returns.
+ */
 export async function flush(timeoutMs = 5000) {
-    if (!draining)
-        return;
-    await Promise.race([draining, new Promise((r) => setTimeout(r, timeoutMs).unref())]);
+    const deadline = Date.now() + timeoutMs;
+    if (draining)
+        await Promise.race([draining, new Promise((r) => setTimeout(r, timeoutMs).unref())]);
+    await control.drain(Math.max(0, deadline - Date.now()));
 }
 /** Record the agent's reasoning at this step. Does nothing outside a governed run. */
 export function logDecision(reasoning, action = null) {

package/dist/errors.d.ts

@@ -11,8 +11,19 @@ export declare class AgentQuarantined extends FencesError {
     constructor(agentName: string, detail?: string);
 }
 /**
- * Thrown by framework integrations when a limit is crossed, because a framework callback
- * can't hand a result back to the agent. Carries the same fields as a breached CheckpointResult.
+ * Thrown instead of running a guarded tool (tool(fn, { guard: true })) that Fences didn't
+ * allow: the run is stopped, over budget, unapproved or quarantined, or Fences couldn't be
+ * reached. The tool's code never ran. reason says why; breachType is set when a limit is the cause.
+ */
+export declare class ToolBlocked extends FencesError {
+    readonly tool: string;
+    readonly reason: string;
+    readonly breachType: string | null;
+    constructor(tool: string, reason: string, breachType?: string | null);
+}
+/**
+ * Thrown when a run is halted from outside the agent's own code: a governed call stuck after a
+ * dashboard stop (see stopGraceS). Carries the same fields as a breached CheckpointResult.
  */
 export declare class FencesStop extends FencesError {
     readonly result: CheckpointResult;

package/dist/errors.js

@@ -17,8 +17,24 @@ export class AgentQuarantined extends FencesError {
     }
 }
 /**
- * Thrown by framework integrations when a limit is crossed, because a framework callback
- * can't hand a result back to the agent. Carries the same fields as a breached CheckpointResult.
+ * Thrown instead of running a guarded tool (tool(fn, { guard: true })) that Fences didn't
+ * allow: the run is stopped, over budget, unapproved or quarantined, or Fences couldn't be
+ * reached. The tool's code never ran. reason says why; breachType is set when a limit is the cause.
+ */
+export class ToolBlocked extends FencesError {
+    tool;
+    reason;
+    breachType;
+    constructor(tool, reason, breachType = null) {
+        super(`Fences blocked ${tool}: ${reason}`);
+        this.tool = tool;
+        this.reason = reason;
+        this.breachType = breachType;
+    }
+}
+/**
+ * Thrown when a run is halted from outside the agent's own code: a governed call stuck after a
+ * dashboard stop (see stopGraceS). Carries the same fields as a breached CheckpointResult.
  */
 export class FencesStop extends FencesError {
     result;

package/dist/index.d.ts

@@ -3,9 +3,10 @@ export type { CheckpointResult, InitOptions, Limits, Extra, Span } from "./core.
 export { context } from "./events.js";
 export type { RedactHook, Event } from "./events.js";
 export { tool } from "./tools.js";
+export type { GuardedToolOptions } from "./tools.js";
 export { requestApproval } from "./control.js";
-export type { Approval } from "./control.js";
+export type { Approval, ControlEvent, Hook } from "./control.js";
 export { priceOf } from "./pricing.js";
 export type { CustomPrice } from "./pricing.js";
-export { FencesError, FencesAuthError, AgentQuarantined, FencesStop } from "./errors.js";
+export { FencesError, FencesAuthError, AgentQuarantined, FencesStop, ToolBlocked } from "./errors.js";
 export { VERSION } from "./version.js";

package/dist/index.js

@@ -3,5 +3,5 @@ export { context } from "./events.js";
 export { tool } from "./tools.js";
 export { requestApproval } from "./control.js";
 export { priceOf } from "./pricing.js";
-export { FencesError, FencesAuthError, AgentQuarantined, FencesStop } from "./errors.js";
+export { FencesError, FencesAuthError, AgentQuarantined, FencesStop, ToolBlocked } from "./errors.js";
 export { VERSION } from "./version.js";

package/dist/prices.generated.d.ts

@@ -8,4 +8,5 @@ export interface Rates {
 export interface PriceEntry extends Rates {
     above?: number;
     tier?: Rates;
+    max_out?: number;
 }

package/dist/prices.generated.js

@@ -1,3 +1,3 @@
 // Generated by scripts/prices.mjs from sdk/agentfences/prices.json. Do not edit.
-// LiteLLM model_prices_and_context_window.json, MIT License, Copyright (c) 2023 Berri AI, fetched 2026-10-09
-export const PRICES = { "chat-latest": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7 }, "claude-fable-5": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125 }, "claude-fable-5-1": { "in": 0.00001, "out": 0.00005, "cache_read": 2.5e-7, "cache_write": 0.0000125 }, "claude-haiku-4-5": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7, "cache_write": 0.00000125 }, "claude-haiku-4-5-20251001": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7, "cache_write": 0.00000125 }, "claude-haiku-5-5": { "in": 1e-7, "out": 5e-7, "cache_read": 1e-8, "cache_write": 1.25e-7 }, "claude-mythos-5": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125 }, "claude-mythos-5-1": { "in": 0.00001, "out": 0.00005, "cache_read": 2.5e-7, "cache_write": 0.0000125 }, "claude-mythos-preview": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125 }, "claude-opus-4-5": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-5-20251101": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-6": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-6-20260205": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-7": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-7-20260416": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-8": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-5": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-5-5": { "in": 0.000004, "out": 0.00002, "cache_read": 2e-7, "cache_write": 0.000005 }, "claude-sonnet-4-5": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375 }, "claude-sonnet-4-5-20250929": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375 }, "claude-sonnet-4-6": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375 }, "claude-sonnet-5": { "in": 0.000002, "out": 0.00001, "cache_read": 2e-7, "cache_write": 0.0000025 }, "claude-sonnet-5-5": { "in": 0.000002, "out": 0.00001, "cache_read": 1e-7, "cache_write": 0.0000025 }, "codestral-2508": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8 }, "codestral-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8 }, "codestral-mamba-latest": { "in": 2.5e-7, "out": 2.5e-7, "cache_read": 2.5e-8 }, "computer-use-preview": { "in": 0.000003, "out": 0.000012 }, "daybreak-blue-latest": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "daybreak-red-latest": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "deep-research-max-preview-04-2026": { "in": 0.000002, "out": 0.000012 }, "deep-research-preview-04-2026": { "in": 0.000002, "out": 0.000012 }, "deep-research-pro-preview-12-2025": { "in": 0.000002, "out": 0.000012 }, "deepseek-chat": { "in": 2.8e-7, "out": 4.2e-7, "cache_read": 2.8e-8 }, "deepseek-coder": { "in": 1.4e-7, "out": 2.8e-7, "cache_read": 1.4e-8 }, "deepseek-flash": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0 }, "deepseek-r1": { "in": 5.5e-7, "out": 0.00000219, "cache_read": 1.4e-7 }, "deepseek-reasoner": { "in": 2.8e-7, "out": 4.2e-7, "cache_read": 2.8e-8 }, "deepseek-v3": { "in": 2.7e-7, "out": 0.0000011, "cache_read": 7e-8, "cache_write": 0 }, "deepseek-v3.2": { "in": 2.8e-7, "out": 4e-7, "cache_read": 2.8e-8 }, "deepseek-v4-flash": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0 }, "deepseek-v4-flash-vision-exp": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0 }, "deepseek-v4-pro": { "in": 0.00000132, "out": 0.00000396, "cache_read": 4.4e-8, "cache_write": 0 }, "devstral-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8 }, "devstral-medium-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8 }, "devstral-small-latest": { "in": 1e-7, "out": 3e-7, "cache_read": 1e-8 }, "ft:gpt-3.5-turbo": { "in": 0.000003, "out": 0.000006 }, "ft:gpt-3.5-turbo-0125": { "in": 0.000003, "out": 0.000006 }, "ft:gpt-3.5-turbo-0613": { "in": 0.000003, "out": 0.000006 }, "ft:gpt-3.5-turbo-1106": { "in": 0.000003, "out": 0.000006 }, "ft:gpt-4-0613": { "in": 0.00003, "out": 0.00006 }, "ft:gpt-4.1-2025-04-14": { "in": 0.000003, "out": 0.000012, "cache_read": 7.5e-7 }, "ft:gpt-4.1-mini-2025-04-14": { "in": 8e-7, "out": 0.0000032, "cache_read": 2e-7 }, "ft:gpt-4.1-nano-2025-04-14": { "in": 2e-7, "out": 8e-7, "cache_read": 5e-8 }, "ft:gpt-4o-2024-08-06": { "in": 0.00000375, "out": 0.000015, "cache_read": 0.000001875 }, "ft:gpt-4o-2024-11-20": { "in": 0.00000375, "out": 0.000015, "cache_write": 0.000001875 }, "ft:gpt-4o-mini-2024-07-18": { "in": 3e-7, "out": 0.0000012, "cache_read": 1.5e-7 }, "ft:o4-mini-2025-04-16": { "in": 0.000004, "out": 0.000016, "cache_read": 0.000001 }, "gemini-2.5-computer-use-preview-10-2025": { "in": 0.00000125, "out": 0.00001, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000015 } }, "gemini-2.5-flash": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8 }, "gemini-2.5-flash-lite": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8 }, "gemini-2.5-flash-lite-preview-09-2025": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8 }, "gemini-2.5-flash-preview-09-2025": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8 }, "gemini-2.5-pro": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7 } }, "gemini-2.5-pro-preview-tts": { "in": 0.000001, "out": 0.00002, "cache_read": 1.25e-7 }, "gemini-3-flash-preview": { "in": 5e-7, "out": 0.000003, "cache_read": 5e-8 }, "gemini-3.1-flash-lite": { "in": 2.5e-7, "out": 0.0000015, "cache_read": 2.5e-8 }, "gemini-3.1-flash-lite-preview": { "in": 2.5e-7, "out": 0.0000015, "cache_read": 2.5e-8 }, "gemini-3.1-pro-preview": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-3.1-pro-preview-customtools": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-3.5-flash": { "in": 0.0000015, "out": 0.000009, "cache_read": 1.5e-7 }, "gemini-3.5-flash-lite": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8 }, "gemini-3.6-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8 }, "gemini-3.7-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8 }, "gemini-3.8-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8 }, "gemini-3.8-flash-cyber": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "gemini-exp-1114": { "in": 0, "out": 0 }, "gemini-exp-1206": { "in": 0, "out": 0 }, "gemini-flash-latest": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8 }, "gemini-flash-lite-latest": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8 }, "gemini-gemma-2-27b-it": { "in": 3.5e-7, "out": 0.00000105 }, "gemini-gemma-2-9b-it": { "in": 3.5e-7, "out": 0.00000105 }, "gemini-omni-1.1-flash": { "in": 0.0000015, "out": 0.000009 }, "gemini-omni-flash-preview": { "in": 0.0000015, "out": 0.000009 }, "gemini-pro-latest": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-robotics-er-1.5-preview": { "in": 3e-7, "out": 0.0000025, "cache_read": 0 }, "gemini-robotics-er-2-preview": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7 }, "gemini-robotics-er-2-streaming-preview": { "in": 0.000001, "out": 0.000005 }, "gemma-3-27b-it": { "in": 0, "out": 0 }, "gemma-4-26b-a4b-it": { "in": 0, "out": 0 }, "gemma-4-31b-it": { "in": 0, "out": 0 }, "glm-5-2": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7 }, "gpt-3.5-turbo": { "in": 5e-7, "out": 0.0000015 }, "gpt-3.5-turbo-0125": { "in": 5e-7, "out": 0.0000015 }, "gpt-3.5-turbo-1106": { "in": 0.000001, "out": 0.000002 }, "gpt-3.5-turbo-16k": { "in": 0.000003, "out": 0.000004 }, "gpt-4": { "in": 0.00003, "out": 0.00006 }, "gpt-4-0613": { "in": 0.00003, "out": 0.00006 }, "gpt-4-1106-preview": { "in": 0.00001, "out": 0.00003 }, "gpt-4-turbo": { "in": 0.00001, "out": 0.00003 }, "gpt-4-turbo-2024-04-09": { "in": 0.00001, "out": 0.00003 }, "gpt-4.1": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7 }, "gpt-4.1-2025-04-14": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7 }, "gpt-4.1-mini": { "in": 4e-7, "out": 0.0000016, "cache_read": 1e-7 }, "gpt-4.1-mini-2025-04-14": { "in": 4e-7, "out": 0.0000016, "cache_read": 1e-7 }, "gpt-4.1-nano": { "in": 1e-7, "out": 4e-7, "cache_read": 2.5e-8 }, "gpt-4.1-nano-2025-04-14": { "in": 1e-7, "out": 4e-7, "cache_read": 2.5e-8 }, "gpt-4o": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125 }, "gpt-4o-2024-05-13": { "in": 0.000005, "out": 0.000015 }, "gpt-4o-2024-08-06": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125 }, "gpt-4o-2024-11-20": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125 }, "gpt-4o-audio-preview-2024-12-17": { "in": 0.0000025, "out": 0.00001 }, "gpt-4o-audio-preview-2025-06-03": { "in": 0.0000025, "out": 0.00001 }, "gpt-4o-mini": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8 }, "gpt-4o-mini-2024-07-18": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8 }, "gpt-4o-mini-audio-preview-2024-12-17": { "in": 1.5e-7, "out": 6e-7 }, "gpt-4o-mini-search-preview": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8 }, "gpt-4o-search-preview": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125 }, "gpt-5": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-2025-08-07": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-chat": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-chat-latest": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-codex": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-mini": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8 }, "gpt-5-mini-2025-08-07": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8 }, "gpt-5-nano": { "in": 5e-8, "out": 4e-7, "cache_read": 5e-9 }, "gpt-5-nano-2025-08-07": { "in": 5e-8, "out": 4e-7, "cache_read": 5e-9 }, "gpt-5-pro": { "in": 0.000015, "out": 0.00012 }, "gpt-5-pro-2025-10-06": { "in": 0.000015, "out": 0.00012 }, "gpt-5-search-api": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-search-api-2025-10-14": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1-2025-11-13": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1-chat-latest": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1-codex": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1-codex-max": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1-codex-mini": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8 }, "gpt-5.2": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.2-2025-12-11": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.2-chat-latest": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.2-codex": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.2-pro": { "in": 0.000021, "out": 0.000168 }, "gpt-5.2-pro-2025-12-11": { "in": 0.000021, "out": 0.000168 }, "gpt-5.3-chat-latest": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.3-codex": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.4": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7, "above": 272000, "tier": { "in": 0.000005, "out": 0.0000225, "cache_read": 5e-7 } }, "gpt-5.4-2026-03-05": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7, "above": 272000, "tier": { "in": 0.000005, "out": 0.0000225, "cache_read": 5e-7 } }, "gpt-5.4-mini": { "in": 7.5e-7, "out": 0.0000045, "cache_read": 7.5e-8 }, "gpt-5.4-mini-2026-03-17": { "in": 7.5e-7, "out": 0.0000045, "cache_read": 7.5e-8 }, "gpt-5.4-nano": { "in": 2e-7, "out": 0.00000125, "cache_read": 2e-8 }, "gpt-5.4-nano-2026-03-17": { "in": 2e-7, "out": 0.00000125, "cache_read": 2e-8 }, "gpt-5.4-pro": { "in": 0.00003, "out": 0.00018, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.4-pro-2026-03-05": { "in": 0.00003, "out": 0.00018, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.5": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7, "above": 272000, "tier": { "in": 0.00001, "out": 0.000045, "cache_read": 0.000001 } }, "gpt-5.5-2026-04-23": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7, "above": 272000, "tier": { "in": 0.00001, "out": 0.000045, "cache_read": 0.000001 } }, "gpt-5.5-cyber": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125 }, "gpt-5.5-pro": { "in": 0.00003, "out": 0.00018, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.5-pro-2026-04-23": { "in": 0.00003, "out": 0.00018, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.6": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-5.6-cyber": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "gpt-5.6-luna": { "in": 2e-7, "out": 0.0000012, "cache_read": 2e-8, "cache_write": 2.5e-7, "above": 272000, "tier": { "in": 4e-7, "out": 0.0000018, "cache_read": 4e-8, "cache_write": 5e-7 } }, "gpt-5.6-sol": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-5.6-terra": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "cache_write": 0.0000025, "above": 272000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7, "cache_write": 0.000005 } }, "gpt-6-astra": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125, "above": 272000, "tier": { "in": 0.00002, "out": 0.000075, "cache_read": 0.000002, "cache_write": 0.000025 } }, "gpt-6-luna": { "in": 1e-7, "out": 5e-7, "cache_read": 1e-8, "cache_write": 1.25e-7, "above": 272000, "tier": { "in": 2e-7, "out": 7.5e-7, "cache_read": 2e-8, "cache_write": 2.5e-7 } }, "gpt-6-sol": { "in": 0.000002, "out": 0.00001, "cache_read": 2e-7, "cache_write": 0.0000025, "above": 272000, "tier": { "in": 0.000004, "out": 0.000015, "cache_read": 4e-7, "cache_write": 0.000005 } }, "gpt-6.1-sol": { "in": 0.000002, "out": 0.00001, "cache_read": 1e-7, "cache_write": 0.0000025, "above": 272000, "tier": { "in": 0.000004, "out": 0.000015, "cache_read": 2e-7, "cache_write": 0.000005 } }, "gpt-audio": { "in": 0.0000025, "out": 0.00001 }, "gpt-audio-1.5": { "in": 0.0000025, "out": 0.00001 }, "gpt-audio-2025-08-28": { "in": 0.0000025, "out": 0.00001 }, "gpt-audio-mini": { "in": 6e-7, "out": 0.0000024 }, "gpt-audio-mini-2025-12-15": { "in": 6e-7, "out": 0.0000024 }, "gpt-daybreak-blue-latest": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-daybreak-red-latest": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "gpt-oss-120b": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8 }, "gpt-oss-20b": { "in": 7.5e-8, "out": 3e-7, "cache_read": 3.75e-8 }, "gpt-oss-safeguard-20b": { "in": 7.5e-8, "out": 3e-7, "cache_read": 3.7e-8 }, "gpt-rosalind-discovery": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7 }, "gpt-rosalind-research": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7 }, "grok-4.20": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-non-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-beta-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-experimental-beta-0304": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-experimental-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning-gv2": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning-gv2": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.3": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.3-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.5": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-4.5-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-4.6": { "in": 0.000002, "out": 0.000006, "cache_read": 5e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 0.000001 } }, "grok-4.7": { "in": 0.000002, "out": 0.000006, "cache_read": 5e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 0.000001 } }, "grok-build-0.1": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-build-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-code-fast": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-code-fast-1": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-code-fast-1-0825": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "labs-leanstral-1-5": { "in": 0, "out": 0 }, "labs-leanstral-1-5-1": { "in": 0, "out": 0 }, "learnlm-1.5-pro-experimental": { "in": 0, "out": 0 }, "llama-guard-3-8b": { "in": 2e-7, "out": 2e-7 }, "llama-prompt-guard-2-22m": { "in": 3e-8, "out": 3e-8 }, "llama-prompt-guard-2-86m": { "in": 4e-8, "out": 4e-8 }, "lyria-3-clip-preview": { "in": 0, "out": 0 }, "lyria-3-pro-preview": { "in": 0, "out": 0 }, "lyria-3.5": { "in": 0, "out": 0 }, "lyria-3.5-clip-preview": { "in": 0, "out": 0 }, "lyria-3.5-pro-preview": { "in": 0, "out": 0 }, "lyria-realtime-exp": { "in": 0, "out": 0 }, "magistral-medium-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "magistral-small-latest": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8 }, "ministral-14b-2512": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8 }, "ministral-14b-latest": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8 }, "ministral-3-14b-2512": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8 }, "ministral-3-3b-2512": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8 }, "ministral-3-8b-2512": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8 }, "ministral-3b-2512": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8 }, "ministral-3b-latest": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8 }, "ministral-8b-2512": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8 }, "ministral-8b-latest": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8 }, "mistral-code-agent-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8 }, "mistral-code-fim-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8 }, "mistral-code-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8 }, "mistral-large-2512": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8 }, "mistral-large-3": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8 }, "mistral-large-4": { "in": 6.8e-7, "out": 0.00000209, "cache_read": 6.8e-8 }, "mistral-large-4-0": { "in": 6.8e-7, "out": 0.00000209, "cache_read": 6.8e-8 }, "mistral-large-latest": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8 }, "mistral-medium": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-medium-2604": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-medium-3": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-medium-3-5": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-medium-3.5": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-medium-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-small": { "in": 1e-7, "out": 3e-7, "cache_read": 1e-8 }, "mistral-small-2603": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8 }, "mistral-small-latest": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8 }, "mistral-tiny": { "in": 2.5e-7, "out": 2.5e-7, "cache_read": 2.5e-8 }, "mistral-vibe-cli-fast": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8 }, "mistral-vibe-cli-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-vibe-cli-with-tools": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "o1": { "in": 0.000015, "out": 0.00006, "cache_read": 0.0000075 }, "o1-2024-12-17": { "in": 0.000015, "out": 0.00006, "cache_read": 0.0000075 }, "o1-pro": { "in": 0.00015, "out": 0.0006 }, "o1-pro-2025-03-19": { "in": 0.00015, "out": 0.0006 }, "o3": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7 }, "o3-2025-04-16": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7 }, "o3-deep-research": { "in": 0.00001, "out": 0.00004, "cache_read": 0.0000025 }, "o3-mini": { "in": 0.0000011, "out": 0.0000044, "cache_read": 5.5e-7 }, "o3-mini-2025-01-31": { "in": 0.0000011, "out": 0.0000044, "cache_read": 5.5e-7 }, "o3-pro": { "in": 0.00002, "out": 0.00008 }, "o3-pro-2025-06-10": { "in": 0.00002, "out": 0.00008 }, "o4-mini": { "in": 0.0000011, "out": 0.0000044, "cache_read": 2.75e-7 }, "o4-mini-2025-04-16": { "in": 0.0000011, "out": 0.0000044, "cache_read": 2.75e-7 }, "o4-mini-deep-research": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7 }, "open-mistral-nemo": { "in": 3e-7, "out": 3e-7, "cache_read": 3e-8 }, "pixtral-large-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 2e-7 }, "qwen3.8-27b": { "in": 8e-7, "out": 0.000004 }, "voxtral-small-2507": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8 }, "voxtral-small-latest": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8 }, "zai-glm-5": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7 }, "zai-glm-5-2": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7 }, "zai-glm-5-3": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7 }, "zai-glm-latest": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7 } };
+// LiteLLM model_prices_and_context_window.json, MIT License, Copyright (c) 2023 Berri AI, fetched 2026-10-13
+export const PRICES = { "chat-latest": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7, "max_out": 128000 }, "claude-fable-5": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125, "max_out": 128000 }, "claude-fable-5-1": { "in": 0.00001, "out": 0.00005, "cache_read": 2.5e-7, "cache_write": 0.0000125, "max_out": 128000 }, "claude-haiku-4-5": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7, "cache_write": 0.00000125, "max_out": 64000 }, "claude-haiku-4-5-20251001": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7, "cache_write": 0.00000125, "max_out": 64000 }, "claude-haiku-5-5": { "in": 1e-7, "out": 5e-7, "cache_read": 1e-8, "cache_write": 1.25e-7, "max_out": 128000 }, "claude-mythos-5": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125, "max_out": 128000 }, "claude-mythos-5-1": { "in": 0.00001, "out": 0.00005, "cache_read": 2.5e-7, "cache_write": 0.0000125, "max_out": 128000 }, "claude-mythos-preview": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125, "max_out": 128000 }, "claude-opus-4-5": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 64000 }, "claude-opus-4-5-20251101": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 64000 }, "claude-opus-4-6": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-4-6-20260205": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-4-7": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-4-7-20260416": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-4-8": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-5": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-5-5": { "in": 0.000004, "out": 0.00002, "cache_read": 2e-7, "cache_write": 0.000005, "max_out": 128000 }, "claude-sonnet-4-5": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375, "max_out": 64000 }, "claude-sonnet-4-5-20250929": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375, "max_out": 64000 }, "claude-sonnet-4-6": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375, "max_out": 128000 }, "claude-sonnet-5": { "in": 0.000002, "out": 0.00001, "cache_read": 2e-7, "cache_write": 0.0000025, "max_out": 128000 }, "claude-sonnet-5-5": { "in": 0.000002, "out": 0.00001, "cache_read": 1e-7, "cache_write": 0.0000025, "max_out": 128000 }, "codestral-2508": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8, "max_out": 128000 }, "codestral-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8, "max_out": 128000 }, "codestral-mamba-latest": { "in": 2.5e-7, "out": 2.5e-7, "cache_read": 2.5e-8, "max_out": 256000 }, "computer-use-preview": { "in": 0.000003, "out": 0.000012, "max_out": 1024 }, "computer-use-preview-2025-03-11": { "in": 0.000003, "out": 0.000012, "max_out": 1024 }, "daybreak-blue-latest": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "max_out": 128000, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "daybreak-red-latest": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "max_out": 128000, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "deep-research-max-preview-04-2026": { "in": 0.000002, "out": 0.000012, "max_out": 65536 }, "deep-research-preview-04-2026": { "in": 0.000002, "out": 0.000012, "max_out": 65536 }, "deep-research-pro-preview-12-2025": { "in": 0.000002, "out": 0.000012, "max_out": 65536 }, "deepseek-chat": { "in": 2.8e-7, "out": 4.2e-7, "cache_read": 2.8e-8, "max_out": 8192 }, "deepseek-coder": { "in": 1.4e-7, "out": 2.8e-7, "cache_read": 1.4e-8, "max_out": 4096 }, "deepseek-flash": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0, "max_out": 393216 }, "deepseek-r1": { "in": 5.5e-7, "out": 0.00000219, "cache_read": 1.4e-7, "max_out": 8192 }, "deepseek-reasoner": { "in": 2.8e-7, "out": 4.2e-7, "cache_read": 2.8e-8, "max_out": 65536 }, "deepseek-v3": { "in": 2.7e-7, "out": 0.0000011, "cache_read": 7e-8, "cache_write": 0, "max_out": 8192 }, "deepseek-v3.2": { "in": 2.8e-7, "out": 4e-7, "cache_read": 2.8e-8, "max_out": 163840 }, "deepseek-v4-flash": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0, "max_out": 393216 }, "deepseek-v4-flash-vision-exp": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0, "max_out": 393216 }, "deepseek-v4-pro": { "in": 0.00000132, "out": 0.00000396, "cache_read": 4.4e-8, "cache_write": 0, "max_out": 393216 }, "devstral-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8, "max_out": 256000 }, "devstral-medium-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8, "max_out": 256000 }, "devstral-small-latest": { "in": 1e-7, "out": 3e-7, "cache_read": 1e-8, "max_out": 256000 }, "ft:gpt-3.5-turbo": { "in": 0.000003, "out": 0.000006, "max_out": 4096 }, "ft:gpt-3.5-turbo-0125": { "in": 0.000003, "out": 0.000006, "max_out": 4096 }, "ft:gpt-3.5-turbo-0613": { "in": 0.000003, "out": 0.000006, "max_out": 4096 }, "ft:gpt-3.5-turbo-1106": { "in": 0.000003, "out": 0.000006, "max_out": 4096 }, "ft:gpt-4-0613": { "in": 0.00003, "out": 0.00006, "max_out": 4096 }, "ft:gpt-4.1-2025-04-14": { "in": 0.000003, "out": 0.000012, "cache_read": 7.5e-7, "max_out": 32768 }, "ft:gpt-4.1-mini-2025-04-14": { "in": 8e-7, "out": 0.0000032, "cache_read": 2e-7, "max_out": 32768 }, "ft:gpt-4.1-nano-2025-04-14": { "in": 2e-7, "out": 8e-7, "cache_read": 5e-8, "max_out": 32768 }, "ft:gpt-4o-2024-08-06": { "in": 0.00000375, "out": 0.000015, "cache_read": 0.000001875, "max_out": 16384 }, "ft:gpt-4o-2024-11-20": { "in": 0.00000375, "out": 0.000015, "cache_write": 0.000001875, "max_out": 16384 }, "ft:gpt-4o-mini-2024-07-18": { "in": 3e-7, "out": 0.0000012, "cache_read": 1.5e-7, "max_out": 16384 }, "ft:o4-mini-2025-04-16": { "in": 0.000004, "out": 0.000016, "cache_read": 0.000001, "max_out": 100000 }, "gemini-2.5-computer-use-preview-10-2025": { "in": 0.00000125, "out": 0.00001, "max_out": 64000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000015 } }, "gemini-2.5-flash": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8, "max_out": 65536 }, "gemini-2.5-flash-lite": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8, "max_out": 65536 }, "gemini-2.5-flash-lite-preview-09-2025": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8, "max_out": 65535 }, "gemini-2.5-flash-preview-09-2025": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8, "max_out": 65535 }, "gemini-2.5-pro": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 65536, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7 } }, "gemini-2.5-pro-preview-tts": { "in": 0.000001, "out": 0.00002, "cache_read": 1.25e-7, "max_out": 16384 }, "gemini-3-flash-preview": { "in": 5e-7, "out": 0.000003, "cache_read": 5e-8, "max_out": 65536 }, "gemini-3.1-flash-lite": { "in": 2.5e-7, "out": 0.0000015, "cache_read": 2.5e-8, "max_out": 65536 }, "gemini-3.1-flash-lite-preview": { "in": 2.5e-7, "out": 0.0000015, "cache_read": 2.5e-8, "max_out": 65536 }, "gemini-3.1-pro-preview": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "max_out": 65536, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-3.1-pro-preview-customtools": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "max_out": 65536, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-3.5-flash": { "in": 0.0000015, "out": 0.000009, "cache_read": 1.5e-7, "max_out": 65536 }, "gemini-3.5-flash-lite": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8, "max_out": 65536 }, "gemini-3.6-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8, "max_out": 65536 }, "gemini-3.7-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8, "max_out": 65536 }, "gemini-3.8-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8, "max_out": 65536 }, "gemini-3.8-flash-cyber": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 65536 }, "gemini-4-argon": { "in": 0.000002, "out": 0.00001, "cache_read": 1e-7, "max_out": 65536 }, "gemini-exp-1114": { "in": 0, "out": 0, "max_out": 8192 }, "gemini-exp-1206": { "in": 0, "out": 0, "max_out": 8192 }, "gemini-flash-latest": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8, "max_out": 65536 }, "gemini-flash-lite-latest": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8, "max_out": 65536 }, "gemini-gemma-2-27b-it": { "in": 3.5e-7, "out": 0.00000105, "max_out": 8192 }, "gemini-gemma-2-9b-it": { "in": 3.5e-7, "out": 0.00000105, "max_out": 8192 }, "gemini-omni-1.1-flash": { "in": 0.0000015, "out": 0.000009, "max_out": 65536 }, "gemini-omni-flash-preview": { "in": 0.0000015, "out": 0.000009, "max_out": 65536 }, "gemini-pro-latest": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "max_out": 65536, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-robotics-er-1.5-preview": { "in": 3e-7, "out": 0.0000025, "cache_read": 0, "max_out": 65535 }, "gemini-robotics-er-2-preview": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7, "max_out": 65536 }, "gemini-robotics-er-2-streaming-preview": { "in": 0.000001, "out": 0.000005, "max_out": 65536 }, "gemma-3-27b-it": { "in": 0, "out": 0, "max_out": 8192 }, "gemma-4-26b-a4b-it": { "in": 0, "out": 0, "max_out": 32768 }, "gemma-4-31b-it": { "in": 0, "out": 0, "max_out": 32768 }, "glm-5-2": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7, "max_out": 131072 }, "gpt-3.5-turbo": { "in": 5e-7, "out": 0.0000015, "max_out": 4096 }, "gpt-3.5-turbo-0125": { "in": 5e-7, "out": 0.0000015, "max_out": 4096 }, "gpt-3.5-turbo-1106": { "in": 0.000001, "out": 0.000002, "max_out": 4096 }, "gpt-3.5-turbo-16k": { "in": 0.000003, "out": 0.000004, "max_out": 4096 }, "gpt-4": { "in": 0.00003, "out": 0.00006, "max_out": 4096 }, "gpt-4-0613": { "in": 0.00003, "out": 0.00006, "max_out": 4096 }, "gpt-4-1106-preview": { "in": 0.00001, "out": 0.00003, "max_out": 4096 }, "gpt-4-turbo": { "in": 0.00001, "out": 0.00003, "max_out": 4096 }, "gpt-4-turbo-2024-04-09": { "in": 0.00001, "out": 0.00003, "max_out": 4096 }, "gpt-4.1": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 32768 }, "gpt-4.1-2025-04-14": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 32768 }, "gpt-4.1-mini": { "in": 4e-7, "out": 0.0000016, "cache_read": 1e-7, "max_out": 32768 }, "gpt-4.1-mini-2025-04-14": { "in": 4e-7, "out": 0.0000016, "cache_read": 1e-7, "max_out": 32768 }, "gpt-4.1-nano": { "in": 1e-7, "out": 4e-7, "cache_read": 2.5e-8, "max_out": 32768 }, "gpt-4.1-nano-2025-04-14": { "in": 1e-7, "out": 4e-7, "cache_read": 2.5e-8, "max_out": 32768 }, "gpt-4o": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125, "max_out": 16384 }, "gpt-4o-2024-05-13": { "in": 0.000005, "out": 0.000015, "max_out": 4096 }, "gpt-4o-2024-08-06": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125, "max_out": 16384 }, "gpt-4o-2024-11-20": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125, "max_out": 16384 }, "gpt-4o-audio-preview-2024-12-17": { "in": 0.0000025, "out": 0.00001, "max_out": 16384 }, "gpt-4o-audio-preview-2025-06-03": { "in": 0.0000025, "out": 0.00001, "max_out": 16384 }, "gpt-4o-mini": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8, "max_out": 16384 }, "gpt-4o-mini-2024-07-18": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8, "max_out": 16384 }, "gpt-4o-mini-audio-preview-2024-12-17": { "in": 1.5e-7, "out": 6e-7, "max_out": 16384 }, "gpt-4o-mini-search-preview": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8, "max_out": 16384 }, "gpt-4o-mini-search-preview-2025-03-11": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8, "max_out": 16384 }, "gpt-4o-search-preview": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125, "max_out": 16384 }, "gpt-4o-search-preview-2025-03-11": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125, "max_out": 16384 }, "gpt-5": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5-2025-08-07": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5-chat": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 16384 }, "gpt-5-chat-latest": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 16384 }, "gpt-5-codex": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5-mini": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8, "max_out": 128000 }, "gpt-5-mini-2025-08-07": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8, "max_out": 128000 }, "gpt-5-nano": { "in": 5e-8, "out": 4e-7, "cache_read": 5e-9, "max_out": 128000 }, "gpt-5-nano-2025-08-07": { "in": 5e-8, "out": 4e-7, "cache_read": 5e-9, "max_out": 128000 }, "gpt-5-pro": { "in": 0.000015, "out": 0.00012, "max_out": 272000 }, "gpt-5-pro-2025-10-06": { "in": 0.000015, "out": 0.00012, "max_out": 272000 }, "gpt-5-search-api": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5-search-api-2025-10-14": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5.1": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5.1-2025-11-13": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5.1-chat-latest": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 16384 }, "gpt-5.1-codex": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5.1-codex-max": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5.1-codex-mini": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8, "max_out": 128000 }, "gpt-5.2": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 128000 }, "gpt-5.2-2025-12-11": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 128000 }, "gpt-5.2-chat-latest": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 16384 }, "gpt-5.2-codex": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 128000 }, "gpt-5.2-pro": { "in": 0.000021, "out": 0.000168, "max_out": 128000 }, "gpt-5.2-pro-2025-12-11": { "in": 0.000021, "out": 0.000168, "max_out": 128000 }, "gpt-5.3-chat-latest": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 16384 }, "gpt-5.3-codex": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 128000 }, "gpt-5.4": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7, "max_out": 128000, "above": 272000, "tier": { "in": 0.000005, "out": 0.0000225, "cache_read": 5e-7 } }, "gpt-5.4-2026-03-05": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7, "max_out": 128000, "above": 272000, "tier": { "in": 0.000005, "out": 0.0000225, "cache_read": 5e-7 } }, "gpt-5.4-mini": { "in": 7.5e-7, "out": 0.0000045, "cache_read": 7.5e-8, "max_out": 128000 }, "gpt-5.4-mini-2026-03-17": { "in": 7.5e-7, "out": 0.0000045, "cache_read": 7.5e-8, "max_out": 128000 }, "gpt-5.4-nano": { "in": 2e-7, "out": 0.00000125, "cache_read": 2e-8, "max_out": 128000 }, "gpt-5.4-nano-2026-03-17": { "in": 2e-7, "out": 0.00000125, "cache_read": 2e-8, "max_out": 128000 }, "gpt-5.4-pro": { "in": 0.00003, "out": 0.00018, "max_out": 128000, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.4-pro-2026-03-05": { "in": 0.00003, "out": 0.00018, "max_out": 128000, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.5": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7, "max_out": 128000, "above": 272000, "tier": { "in": 0.00001, "out": 0.000045, "cache_read": 0.000001 } }, "gpt-5.5-2026-04-23": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7, "max_out": 128000, "above": 272000, "tier": { "in": 0.00001, "out": 0.000045, "cache_read": 0.000001 } }, "gpt-5.5-cyber": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125 }, "gpt-5.5-pro": { "in": 0.00003, "out": 0.00018, "max_out": 128000, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.5-pro-2026-04-23": { "in": 0.00003, "out": 0.00018, "max_out": 128000, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.6": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "max_out": 128000, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-5.6-cyber": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "max_out": 128000, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "gpt-5.6-luna": { "in": 2e-7, "out": 0.0000012, "cache_read": 2e-8, "cache_write": 2.5e-7, "max_out": 128000, "above": 272000, "tier": { "in": 4e-7, "out": 0.0000018, "cache_read": 4e-8, "cache_write": 5e-7 } }, "gpt-5.6-sol": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "max_out": 128000, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-5.6-terra": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "cache_write": 0.0000025, "max_out": 128000, "above": 272000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7, "cache_write": 0.000005 } }, "gpt-6-astra": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125, "max_out": 128000, "above": 272000, "tier": { "in": 0.00002, "out": 0.000075, "cache_read": 0.000002, "cache_write": 0.000025 } }, "gpt-6-luna": { "in": 1e-7, "out": 5e-7, "cache_read": 1e-8, "cache_write": 1.25e-7, "max_out": 128000, "above": 272000, "tier": { "in": 2e-7, "out": 7.5e-7, "cache_read": 2e-8, "cache_write": 2.5e-7 } }, "gpt-6-sol": { "in": 0.000002, "out": 0.00001, "cache_read": 2e-7, "cache_write": 0.0000025, "max_out": 128000, "above": 272000, "tier": { "in": 0.000004, "out": 0.000015, "cache_read": 4e-7, "cache_write": 0.000005 } }, "gpt-6.1-sol": { "in": 0.000002, "out": 0.00001, "cache_read": 1e-7, "cache_write": 0.0000025, "max_out": 128000, "above": 272000, "tier": { "in": 0.000004, "out": 0.000015, "cache_read": 2e-7, "cache_write": 0.000005 } }, "gpt-audio": { "in": 0.0000025, "out": 0.00001, "max_out": 16384 }, "gpt-audio-1.5": { "in": 0.0000025, "out": 0.00001, "max_out": 16384 }, "gpt-audio-2025-08-28": { "in": 0.0000025, "out": 0.00001, "max_out": 16384 }, "gpt-audio-mini": { "in": 6e-7, "out": 0.0000024, "max_out": 16384 }, "gpt-audio-mini-2025-10-06": { "in": 6e-7, "out": 0.0000024, "max_out": 16384 }, "gpt-audio-mini-2025-12-15": { "in": 6e-7, "out": 0.0000024, "max_out": 16384 }, "gpt-daybreak-blue-latest": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "max_out": 128000, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-daybreak-red-latest": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "max_out": 128000, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "gpt-oss-120b": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8, "max_out": 65536 }, "gpt-oss-20b": { "in": 7.5e-8, "out": 3e-7, "cache_read": 3.75e-8, "max_out": 65536 }, "gpt-oss-safeguard-20b": { "in": 7.5e-8, "out": 3e-7, "cache_read": 3.7e-8, "max_out": 65536 }, "gpt-rosalind-discovery": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7 }, "gpt-rosalind-research": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7 }, "grok-4.20": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-non-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-beta-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-experimental-beta-0304": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-experimental-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning-gv2": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning-gv2": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.3": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.3-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.5": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "max_out": 500000, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-4.5-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "max_out": 500000, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-4.6": { "in": 0.000002, "out": 0.000006, "cache_read": 5e-7, "max_out": 500000, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 0.000001 } }, "grok-4.7": { "in": 0.000002, "out": 0.000006, "cache_read": 5e-7, "max_out": 500000, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 0.000001 } }, "grok-build-0.1": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "max_out": 256000, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-build-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "max_out": 500000, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-code-fast": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "max_out": 256000, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-code-fast-1": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "max_out": 256000, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-code-fast-1-0825": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "max_out": 256000, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "labs-leanstral-1-5": { "in": 0, "out": 0, "max_out": 131072 }, "labs-leanstral-1-5-1": { "in": 0, "out": 0, "max_out": 131072 }, "learnlm-1.5-pro-experimental": { "in": 0, "out": 0, "max_out": 8192 }, "llama-guard-3-8b": { "in": 2e-7, "out": 2e-7 }, "llama-prompt-guard-2-22m": { "in": 3e-8, "out": 3e-8, "max_out": 512 }, "llama-prompt-guard-2-86m": { "in": 4e-8, "out": 4e-8, "max_out": 512 }, "lyria-3-clip-preview": { "in": 0, "out": 0, "max_out": 8192 }, "lyria-3-pro-preview": { "in": 0, "out": 0, "max_out": 8192 }, "lyria-3.5": { "in": 0, "out": 0, "max_out": 65536 }, "lyria-3.5-clip-preview": { "in": 0, "out": 0, "max_out": 8192 }, "lyria-3.5-pro-preview": { "in": 0, "out": 0, "max_out": 8192 }, "lyria-realtime-exp": { "in": 0, "out": 0, "max_out": 65536 }, "magistral-medium-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "magistral-small-latest": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "ministral-14b-2512": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8, "max_out": 262144 }, "ministral-14b-latest": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8, "max_out": 262144 }, "ministral-3-14b-2512": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8, "max_out": 262144 }, "ministral-3-3b-2512": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8, "max_out": 131072 }, "ministral-3-8b-2512": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "ministral-3b-2512": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8, "max_out": 131072 }, "ministral-3b-latest": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8, "max_out": 131072 }, "ministral-8b-2512": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "ministral-8b-latest": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "mistral-code-agent-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8, "max_out": 256000 }, "mistral-code-fim-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8, "max_out": 128000 }, "mistral-code-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8, "max_out": 128000 }, "mistral-large-2512": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8, "max_out": 262144 }, "mistral-large-3": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8, "max_out": 262144 }, "mistral-large-4": { "in": 6.8e-7, "out": 0.00000209, "cache_read": 6.8e-8 }, "mistral-large-4-0": { "in": 6.8e-7, "out": 0.00000209, "cache_read": 6.8e-8 }, "mistral-large-latest": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8, "max_out": 262144 }, "mistral-medium": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-medium-2604": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-medium-3": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-medium-3-5": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-medium-3.5": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-medium-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-small": { "in": 1e-7, "out": 3e-7, "cache_read": 1e-8, "max_out": 8191 }, "mistral-small-2603": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "mistral-small-latest": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "mistral-tiny": { "in": 2.5e-7, "out": 2.5e-7, "cache_read": 2.5e-8, "max_out": 8191 }, "mistral-vibe-cli-fast": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "mistral-vibe-cli-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-vibe-cli-with-tools": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "o1": { "in": 0.000015, "out": 0.00006, "cache_read": 0.0000075, "max_out": 100000 }, "o1-2024-12-17": { "in": 0.000015, "out": 0.00006, "cache_read": 0.0000075, "max_out": 100000 }, "o1-pro": { "in": 0.00015, "out": 0.0006, "max_out": 100000 }, "o1-pro-2025-03-19": { "in": 0.00015, "out": 0.0006, "max_out": 100000 }, "o3": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 100000 }, "o3-2025-04-16": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 100000 }, "o3-deep-research": { "in": 0.00001, "out": 0.00004, "cache_read": 0.0000025, "max_out": 100000 }, "o3-deep-research-2025-06-26": { "in": 0.00001, "out": 0.00004, "cache_read": 0.0000025, "max_out": 100000 }, "o3-mini": { "in": 0.0000011, "out": 0.0000044, "cache_read": 5.5e-7, "max_out": 100000 }, "o3-mini-2025-01-31": { "in": 0.0000011, "out": 0.0000044, "cache_read": 5.5e-7, "max_out": 100000 }, "o3-pro": { "in": 0.00002, "out": 0.00008, "max_out": 100000 }, "o3-pro-2025-06-10": { "in": 0.00002, "out": 0.00008, "max_out": 100000 }, "o4-mini": { "in": 0.0000011, "out": 0.0000044, "cache_read": 2.75e-7, "max_out": 100000 }, "o4-mini-2025-04-16": { "in": 0.0000011, "out": 0.0000044, "cache_read": 2.75e-7, "max_out": 100000 }, "o4-mini-deep-research": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 100000 }, "o4-mini-deep-research-2025-06-26": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 100000 }, "open-mistral-nemo": { "in": 3e-7, "out": 3e-7, "cache_read": 3e-8, "max_out": 128000 }, "pixtral-large-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 2e-7, "max_out": 128000 }, "qwen3.8-27b": { "in": 8e-7, "out": 0.000004, "max_out": 16384 }, "voxtral-small-2507": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8, "max_out": 32768 }, "voxtral-small-latest": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8, "max_out": 32768 }, "zai-glm-5": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7, "max_out": 131072 }, "zai-glm-5-2": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7, "max_out": 131072 }, "zai-glm-5-3": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7, "max_out": 131072 }, "zai-glm-latest": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7, "max_out": 131072 } };

package/dist/tools.d.ts

@@ -1,15 +1,49 @@
 /** `{"query":"cats","limit":5}`: the arguments as compact JSON (one object argument on its own), capped. */
 export declare function argsSummary(args: unknown[]): string;
+interface ToolFields<A extends unknown[]> {
+    name?: string;
+    /** Reject with a TimeoutError if the call takes longer. JS can't stop the tool's code; pass run.signal to its fetches. */
+    timeoutS?: number;
+    /** Ask Fences before each call; it runs only if allowed. */
+    guard?: boolean;
+    /** What a call costs the run, reserved before and charged after: a number, or a function of the tool's arguments. */
+    costUsd?: number | ((...args: A) => number);
+    /** A person approves each call from the dashboard first. */
+    approve?: boolean;
+}
+/** Options that make a tool async: a guard (guard, costUsd or approve) or a timeout. */
+export type GuardedToolOptions<A extends unknown[]> = ToolFields<A> & ({
+    guard: true;
+} | {
+    costUsd: number | ((...args: A) => number);
+} | {
+    approve: true;
+} | {
+    timeoutS: number;
+});
 /**
  * Record every call of an agent tool on the active run:
  *
  *     const webSearch = tool(async (query: string) => { ... });
- *     const fetchPage = tool(fetchPageImpl, { name: "fetch" });
+ *     const fetchPage = tool(fetchPageImpl, { name: "fetch", timeoutS: 30 });
  *
  * Records the tool's name, a short summary of its arguments, whether it succeeded (and the
  * error if not) and how long it took. Errors still reach the caller; sync tools stay sync.
  * Outside a governed run it just calls the function.
+ *
+ * Guarded tools ask Fences before they run, for actions with consequences:
+ *
+ *     const issueRefund = tool(refund, { costUsd: (orderId, amount) => amount, approve: true });
+ *
+ * guard: true runs the tool only if the run isn't stopped, paused, over a limit or
+ * quarantined; otherwise it throws ToolBlocked and the tool's code never runs. It's blocked
+ * too if Fences can't be reached (guards fail closed). costUsd is reserved before the call,
+ * so parallel calls can't overspend together, and charged after (unless the tool threw; a
+ * timeout is charged, as it may have happened). approve: true asks a person first.
+ * Setting costUsd or approve guards the tool. A guarded or timed tool returns a promise.
  */
+export declare function tool<A extends unknown[], R>(fn: (...args: A) => R, options: GuardedToolOptions<A>): (...args: A) => Promise<Awaited<R>>;
 export declare function tool<A extends unknown[], R>(fn: (...args: A) => R, options?: {
     name?: string;
 }): (...args: A) => R;
+export {};

package/dist/tools.js

@@ -1,4 +1,8 @@
-import { getActiveRun } from "./core.js";
+import { randomUUID } from "node:crypto";
+import * as control from "./control.js";
+import { _client, getActiveRun, localBreach } from "./core.js";
+import { ToolBlocked } from "./errors.js";
+import * as events from "./events.js";
 import { MAX_ARGS, recordToolCall } from "./spans.js";
 /** `{"query":"cats","limit":5}`: the arguments as compact JSON (one object argument on its own), capped. */
 export function argsSummary(args) {
@@ -11,18 +15,137 @@ export function argsSummary(args) {
     }
     return text.length <= MAX_ARGS ? text : text.slice(0, MAX_ARGS - 1) + "…";
 }
-/**
- * Record every call of an agent tool on the active run:
- *
- *     const webSearch = tool(async (query: string) => { ... });
- *     const fetchPage = tool(fetchPageImpl, { name: "fetch" });
- *
- * Records the tool's name, a short summary of its arguments, whether it succeeded (and the
- * error if not) and how long it took. Errors still reach the caller; sync tools stay sync.
- * Outside a governed run it just calls the function.
- */
+// ── Guards ────────────────────────────────────────────────────────────────────
+function block(run, name, reason, breach = null) {
+    if (run.control.stopped)
+        run.control.stopSeen = true; // the agent learns of the stop here, so don't cancel it
+    throw new ToolBlocked(name, reason, breach);
+}
+const fits = (run, amount) => run.budgetUsd === null || Math.round((run.costUsd + run.reservedUsd + amount) * 1e9) / 1e9 <= run.budgetUsd;
+async function approve(run, name, summary, amount) {
+    const answer = await control.requestApproval(`${name}(${summary})`, { amountUsd: amount || undefined });
+    if (!answer.granted)
+        block(run, name, answer.note ? `not approved: ${answer.note}` : "not approved");
+    return answer.approvalId;
+}
+/** Check a guarded call and reserve its amount; returns the guard id, or throws ToolBlocked. */
+async function open(run, name, summary, amount, needsApproval) {
+    if (run.control.quarantined)
+        block(run, name, "the agent is quarantined in Fences"); // now, not when the quarantine's pause ends
+    if (run.control.paused)
+        await control.waitIfPaused(run);
+    if (run.control.pauseExpired)
+        block(run, name, "the run was paused from the Fences dashboard and not resumed in time", "paused");
+    const approvalId = needsApproval ? await approve(run, name, summary, amount) : null;
+    if (run.control.stopped)
+        block(run, name, "the run was stopped from the Fences dashboard", "stopped_by_user");
+    const client = _client();
+    if (!client) { // local mode: the same rules, applied here
+        const breach = run.lastBreach ?? localBreach(run);
+        if (breach)
+            block(run, name, `the run is over a limit (${breach})`, breach);
+        if (!fits(run, amount))
+            block(run, name, `$${amount.toFixed(2)} more would take the run past its $${run.budgetUsd.toFixed(2)} budget`, "budget_exceeded");
+        run.reservedUsd += amount;
+        return randomUUID();
+    }
+    const call = { guardId: randomUUID(), approvalId }; // one id per call: the server answers a re-check of a denied id afresh
+    for (;;) {
+        try {
+            return await check(run, client, name, summary, amount, call);
+        }
+        catch (e) {
+            if (!(e instanceof ToolBlocked && control.BUDGET_BREACHES.has(e.breachType ?? "") && control.holds(run)))
+                throw e;
+            control.startHold(run, "budget"); // onBreach "hold": wait for someone to raise the budget, then check again
+            await control.waitIfPaused(run);
+            const outcome = control.endHold(run);
+            if (outcome === "stopped")
+                block(run, name, "the run was stopped from the Fences dashboard", "stopped_by_user");
+            if (outcome !== "released")
+                throw e;
+        }
+    }
+}
+async function check(run, client, name, summary, amount, call) {
+    if (run.control.stopped)
+        block(run, name, "the run was stopped from the Fences dashboard", "stopped_by_user");
+    // Check against what this process already holds before asking the server, which can't see it; reserve until it answers
+    if (!fits(run, amount))
+        block(run, name, `$${amount.toFixed(2)} more could take the run past its $${run.budgetUsd.toFixed(2)} budget`, "budget_exceeded");
+    run.reservedUsd += amount;
+    try {
+        const sent = events.redact({ type: "guard", tool: name, arguments: summary }) ?? {}; // the check goes ahead without them
+        let resp = {}; // eslint-disable-line @typescript-eslint/no-explicit-any
+        for (let attempt = 0; attempt < 2; attempt++) { // once more after an approval the server asked for
+            resp = await client.guard(run.runId, { guard_id: call.guardId, phase: "check", tool: name, arguments: sent.arguments ?? null,
+                amount_usd: amount, approval_id: call.approvalId });
+            control.apply(run, resp.commands);
+            if (resp.allow === true)
+                return call.guardId;
+            if (!(resp.needs_approval && call.approvalId === null))
+                break;
+            call.approvalId = await approve(run, name, summary, amount);
+        }
+        if (resp.unsupported) {
+            control.unsupported("guard", "guarded tools", "they are blocked");
+            block(run, name, "this Fences server doesn't support guarded tools");
+        }
+        if (resp.network_error || !("allow" in resp))
+            block(run, name, "couldn't reach Fences to check this call"); // no answer: fail closed
+        block(run, name, resp.reason ?? "not allowed", resp.breach ?? null);
+    }
+    catch (e) {
+        run.reservedUsd -= amount;
+        throw e;
+    }
+}
+/** Release the reservation and charge the run: in full unless the tool threw (a timeout may have done it). */
+async function settle(run, guardId, amount, error, failed) {
+    const outcome = !failed ? "ok" : error?.name === "TimeoutError" ? "unknown" : "error";
+    const charged = outcome === "error" ? 0 : amount;
+    run.reservedUsd -= amount;
+    run.costUsd += charged;
+    await _client()?.guard(run.runId, { guard_id: guardId, phase: "settle", outcome, cost_usd: charged });
+}
+function timed(p, timeoutS, name) {
+    if (timeoutS === undefined)
+        return p;
+    let timer;
+    const late = new Promise((_, reject) => {
+        timer = setTimeout(() => reject(new DOMException(`${name} took longer than ${timeoutS}s`, "TimeoutError")), timeoutS * 1000);
+    });
+    return Promise.race([p, late]).finally(() => clearTimeout(timer));
+}
 export function tool(fn, options = {}) {
     const name = options.name ?? (fn.name || "tool");
+    const guarded = !!options.guard || options.costUsd !== undefined || !!options.approve;
+    if (guarded || options.timeoutS !== undefined) {
+        return async (...args) => {
+            const run = getActiveRun();
+            if (!run)
+                return timed(Promise.resolve().then(() => fn(...args)), options.timeoutS, name);
+            const summary = argsSummary(args), started = performance.now();
+            let gate = null;
+            try {
+                if (guarded) {
+                    const c = options.costUsd, amount = Number((typeof c === "function" ? c(...args) : c) ?? 0);
+                    gate = [await open(run, name, summary, amount, !!options.approve), amount];
+                }
+                const out = await timed(Promise.resolve().then(() => fn(...args)), options.timeoutS, name);
+                recordToolCall(name, summary, started);
+                if (gate)
+                    await settle(run, ...gate, undefined, false);
+                return out;
+            }
+            catch (e) {
+                recordToolCall(name, summary, started, e);
+                if (gate)
+                    await settle(run, ...gate, e, true);
+                throw e;
+            }
+        };
+    }
     return (...args) => {
         if (!getActiveRun())
             return fn(...args);

package/dist/version.d.ts

@@ -1,2 +1,2 @@
 /** The one place the version lives; sent to Fences on every request. Keep in step with package.json. */
-export declare const VERSION = "0.4.0";
+export declare const VERSION = "0.6.0";

package/dist/version.js

@@ -1,2 +1,2 @@
 /** The one place the version lives; sent to Fences on every request. Keep in step with package.json. */
-export const VERSION = "0.4.0";
+export const VERSION = "0.6.0";

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "agentfences",
-  "version": "0.4.0",
+  "version": "0.6.0",
   "description": "On-call for AI agents: limits your agents can't raise, cost tracking, a decision trail, and a stop button",
   "license": "MIT",
   "author": "Bhavik Sardar",