agentfences 0.3.0 → 0.5.0

package/README.md

@@ -59,6 +59,52 @@ init({ apiKey: process.env.FENCES_API_KEY, endpoint: "https://your-fences-host",
 
 The server is authoritative for limits and sees spend across processes. If it can't be reached, limits are enforced locally; pass `failClosed: true` to stop instead. A rejected key throws `FencesAuthError`; a quarantined agent throws `AgentQuarantined` before any of its code runs. In serverless handlers, `await flush()` before returning so queued decisions and spans are sent.
 
+## Live control (from 0.4.0)
+
+In cloud mode a heartbeat (every 15 seconds, `init({ heartbeatS })`) lets whoever is on call act on a running agent from the dashboard:
+
+- **Stop:** the next `checkpoint()` returns `breachType: "stopped_by_user"`, so the agent wraps up gracefully. If the run doesn't reach a checkpoint within `stopGraceS` (default 30) seconds, say it's stuck in a tool, the governed call rejects with `FencesStop` and the run's `signal` aborts (from 0.5.0). JavaScript can't stop running code, so pass `getActiveRun()?.signal` to `fetch` and other cancellable work for a stuck run to really stop. `init({ stopGraceS: null })` turns this off.
+- **Pause and resume:** a paused run waits inside its next `checkpoint()` until it's resumed; after `pauseTimeoutS` (default one hour) it returns `breachType: "paused"`.
+- **Limits** changed in the dashboard apply to the run immediately. **Quarantine** makes the governed call throw `AgentQuarantined` before any agent code runs; runs already going hold at their next checkpoint, and their guarded tools are blocked.
+
+An agent can ask a person before doing something risky:
+
+```ts
+import { requestApproval } from "agentfences";
+
+const approval = await requestApproval("Refund $240 to order 1182?", { amountUsd: 240, timeoutS: 600 });
+if (!approval.granted) return `I didn't issue the refund: ${approval.note}`;
+```
+
+An approved amount raises the run's budget. It never hangs or throws: in local mode, outside a run, or on a server without approvals it's denied right away, and with no answer it's denied after `timeoutS`. The heartbeat's timer never keeps your process alive on its own.
+
+**Containment hooks** (from 0.5.0) run in your process when a stop or quarantine arrives, to contain what Fences can't reach, such as a credential the agent holds:
+
+```ts
+init({ apiKey: "fc_...", onQuarantine: async (event) => vault.revoke(`agent/${event.agentName}`), onStop: (event) => { ... } });
+```
+
+`onStop` runs once per run, and `onQuarantine` once per quarantine however many runs it reaches. Each gets `{ type, runId, agentName, id, by, reason }`. Fences records whether it worked, threw (and why) or ran past 30 seconds. A process that's about to exit waits for its hooks first; in serverless handlers, `await flush()` does the same. The SDK also acknowledges every dashboard command it receives, so the dashboard can tell "the agent has it" from "the agent hasn't acknowledged".
+
+## Guarded tools (from 0.5.0)
+
+For actions with consequences (refunds, payments, writes to production), guard the tool, and it asks Fences **before** it runs:
+
+```ts
+import { tool, ToolBlocked } from "agentfences";
+
+const issueRefund = tool(refund, { costUsd: (orderId: string, amount: number) => amount, approve: true });
+const deploy = tool(deployImpl, { guard: true, timeoutS: 30 });
+```
+
+- The tool runs only if its run isn't stopped, paused, over a limit or quarantined. Otherwise it throws `ToolBlocked` (with `reason` and `breachType`) and its code never runs.
+- `costUsd` (a number, or a function of the tool's arguments) is **reserved** before the call and charged after, so parallel calls can't overspend the budget together. A call that throws is released uncharged; one that times out is charged, because it may have happened.
+- `approve: true` asks a person on the dashboard before each call. The dashboard can also require approval for a tool, and the SDK then asks for it.
+- **Guards fail closed:** if Fences can't be reached, or doesn't support guarded tools, the tool is blocked. In local mode the same rules apply in-process, and `approve` is always denied.
+- `timeoutS` works on any tool: past it, the call rejects with a `TimeoutError`. The tool's own code carries on unless it uses `getActiveRun()?.signal`.
+
+A guarded or timed tool always returns a promise. What each part guarantees: [ENFORCEMENT.md](../ENFORCEMENT.md).
+
 ## Not yet in the TypeScript SDK
 
-The Python SDK also has live control from the dashboard (pause, approvals), automatic recording of OpenAI/Anthropic calls (`instrument`), and LangGraph / OpenAI Agents integrations. They're next. Everything here follows the same server protocol ([PROTOCOL.md](../PROTOCOL.md)).
+The Python SDK also records OpenAI/Anthropic calls automatically (`instrument`) and integrates with LangGraph and the OpenAI Agents SDK. Those are also how it checks a model call against the budget **before** it's sent, so the TypeScript SDK doesn't do that yet: a model call is checked afterwards, by `checkpoint()`, and a run can go over its budget by one call. Everything here follows the same server protocol ([PROTOCOL.md](../PROTOCOL.md)).

package/dist/client.d.ts

@@ -9,6 +9,11 @@ export declare class FencesClient {
     logDecision(runId: string, body: Record<string, unknown>): Promise<Reply>;
     endRun(runId: string, body: Record<string, unknown>): Promise<Reply>;
     logSpans(runId: string, spans: unknown[]): Promise<Reply>;
+    /** Report live runs and acknowledge commands; the reply may carry commands for them. */
+    heartbeat(runs: unknown[], acks?: unknown[]): Promise<Reply>;
+    /** Check a guarded tool call before it runs ({ phase: "check" }), or settle it after ({ phase: "settle" }). */
+    guard(runId: string, body: Record<string, unknown>): Promise<Reply>;
+    requestApproval(runId: string, body: Record<string, unknown>): Promise<Reply>;
     /**
      * optional: an endpoint older servers may not have. A missing route returns
      * { unsupported: true } and nothing throws, not even a rejected key.

package/dist/client.js

@@ -17,6 +17,13 @@ export class FencesClient {
     logDecision(runId, body) { return this.post(`/api/runs/${runId}/decisions`, body); }
     endRun(runId, body) { return this.post(`/api/runs/${runId}/end`, body); }
     logSpans(runId, spans) { return this.post(`/api/runs/${runId}/spans`, { spans }, true); }
+    /** Report live runs and acknowledge commands; the reply may carry commands for them. */
+    heartbeat(runs, acks = []) {
+        return this.post("/api/heartbeat", acks.length ? { runs, acks } : { runs }, true);
+    }
+    /** Check a guarded tool call before it runs ({ phase: "check" }), or settle it after ({ phase: "settle" }). */
+    guard(runId, body) { return this.post(`/api/runs/${runId}/guard`, body, true); }
+    requestApproval(runId, body) { return this.post(`/api/runs/${runId}/approvals`, body, true); }
     /**
      * optional: an endpoint older servers may not have. A missing route returns
      * { unsupported: true } and nothing throws, not even a rejected key.

package/dist/control.d.ts

@@ -0,0 +1,84 @@
+import type { FencesClient, Reply } from "./client.js";
+import type { Run } from "./core.js";
+export interface Approval {
+    granted: boolean;
+    /** Who answered, as the dashboard reports it. */
+    by?: string | null;
+    /** Their note, or why no one could answer. */
+    note?: string | null;
+    /** The amount approved, if one was asked for. */
+    amountUsd?: number | null;
+    approvalId?: string | null;
+}
+/** What onStop and onQuarantine receive. */
+export interface ControlEvent {
+    type: "stop" | "quarantine";
+    runId: string;
+    agentName: string;
+    /** The command's id, if the server sent one. */
+    id: string | null;
+    /** Who pressed the button, as the dashboard reports it. */
+    by: string | null;
+    reason: string | null;
+}
+export type Hook = (event: ControlEvent) => unknown;
+/** Live-control state a run carries. */
+export interface Control {
+    stopped: boolean;
+    stoppedAt: number;
+    /** The agent got its stop from a checkpoint (or a blocked tool): it's never cancelled. */
+    stopSeen: boolean;
+    cancelled: boolean;
+    /** Set by governed(): halts the call when a stop goes unseen past stopGraceS. */
+    onCancel: (() => void) | null;
+    paused: boolean;
+    pauseExpired: boolean;
+    quarantined: boolean;
+    /** approval id -> the answer, or null while waiting */
+    approvals: Map<string, Approval | null>;
+    awaiting: number;
+    /** command ids already acknowledged */
+    acked: Set<string>;
+}
+export declare const newControl: () => Control;
+export declare let pauseTimeoutMs: number;
+export declare const supported: {
+    heartbeat: boolean;
+    approvals: boolean;
+    guard: boolean;
+};
+export interface ControlOptions {
+    heartbeatS: number;
+    pauseTimeoutS: number;
+    stopGraceS: number | null;
+    onStop?: Hook | null;
+    onQuarantine?: Hook | null;
+}
+export declare function configure(c: FencesClient | null, o: ControlOptions): void;
+export declare function register(run: Run): void;
+export declare function unregister(run: Run): void;
+export declare function unsupported(kind: keyof typeof supported, what: string, consequence: string): void;
+/** Apply the commands addressed to this run (from a heartbeat or a checkpoint reply), and acknowledge them. Each is safe to apply twice. */
+export declare function apply(run: Run, commands: Reply[] | undefined): void;
+/**
+ * Wait for running hooks, then send the acknowledgements still waiting. flush() calls it, and
+ * it runs before the process exits, so a script that ends right after a stop still finishes
+ * its containment, and says so.
+ */
+export declare function drain(timeoutMs?: number): Promise<void>;
+/** Hold the agent at its checkpoint while its run is paused, up to pauseTimeoutS. */
+export declare function waitIfPaused(run: Run): Promise<void>;
+/**
+ * Ask a person, through the Fences dashboard, to approve something, and wait for the answer:
+ *
+ *     const approval = await requestApproval("Refund $240 to order 1182?", { amountUsd: 240 });
+ *     if (!approval.granted) return `I didn't issue the refund: ${approval.note}`;
+ *
+ * If an amount is approved, the run's budget goes up by that much. Returns denied right away in
+ * local mode, outside a run, or when the server can't take requests, and denied after timeoutS
+ * (default 600) with no answer: it never hangs and never throws.
+ */
+export declare function requestApproval(reason: string, options?: {
+    amountUsd?: number;
+    timeoutS?: number;
+}): Promise<Approval>;

package/dist/control.js

@@ -0,0 +1,288 @@
+/**
+ * Live control from the Fences dashboard: a heartbeat that reports live runs and brings back
+ * commands (stop, pause, resume, quarantine, limits, approval answers) and acknowledges them,
+ * containment hooks, pausing at checkpoints, cancelling a run stuck after a stop, and approval
+ * requests. Cloud mode only; a server without these endpoints gets one warning and runs carry
+ * on as before. Same behaviour as the Python SDK (PROTOCOL.md, "Live control").
+ */
+import { randomUUID } from "node:crypto";
+const FAST_MS = 2000; // heartbeat interval while a run is paused, waiting for an approval, or stopping
+const HOOK_TIMEOUT_MS = 30_000; // a hook still running after this is reported as timed out
+export const newControl = () => ({
+    stopped: false, stoppedAt: 0, stopSeen: false, cancelled: false, onCancel: null, paused: false, pauseExpired: false,
+    quarantined: false, approvals: new Map(), awaiting: 0, acked: new Set(),
+});
+const live = new Map(); // run id -> runs in progress
+let client = null;
+let intervalMs = 15_000;
+export let pauseTimeoutMs = 3_600_000;
+let stopGraceMs = 30_000;
+const hooks = { stop: null, quarantine: null };
+export const supported = { heartbeat: true, approvals: true, guard: true };
+let timer = null;
+let beating = false;
+let acks = []; // acknowledgements waiting for the next heartbeat
+const hooked = new Set(); // quarantine ids whose hook has run in this process
+const runningHooks = new Set();
+export function configure(c, o) {
+    client = c;
+    intervalMs = o.heartbeatS * 1000;
+    pauseTimeoutMs = o.pauseTimeoutS * 1000;
+    stopGraceMs = o.stopGraceS === null ? null : o.stopGraceS * 1000;
+    hooks.stop = o.onStop ?? null;
+    hooks.quarantine = o.onQuarantine ?? null;
+    supported.heartbeat = supported.approvals = supported.guard = true;
+    schedule(0); // a new client or interval takes effect now, not after the old wait
+}
+export function register(run) {
+    live.set(run.runId, run);
+    if (!timer)
+        schedule(nextDelay());
+}
+export function unregister(run) {
+    live.delete(run.runId);
+}
+export function unsupported(kind, what, consequence) {
+    if (!supported[kind])
+        return;
+    supported[kind] = false;
+    console.warn(`agentfences: this Fences server doesn't support ${what} yet, so ${consequence}`);
+}
+// ── Commands ──────────────────────────────────────────────────────────────────
+const LIMITS = { budget_usd: "budgetUsd", max_iterations: "maxIterations", max_duration_ms: "maxDurationMs", max_tokens: "maxTokens" };
+/** Apply the commands addressed to this run (from a heartbeat or a checkpoint reply), and acknowledge them. Each is safe to apply twice. */
+export function apply(run, commands) {
+    for (const c of commands ?? []) {
+        if (c.run_id !== undefined && c.run_id !== run.runId)
+            continue;
+        const ctl = run.control;
+        if (c.type === "stop") {
+            if (!ctl.stopped) {
+                ctl.stopped = true;
+                ctl.stoppedAt = Date.now();
+                schedule(0); // watch for the agent to see it, or cancel it
+                hook("stop", run, c); // once per run
+            }
+            ctl.paused = ctl.quarantined = false;
+        }
+        else if (c.type === "pause" || c.type === "quarantine") { // a quarantined agent's runs hold at their next checkpoint
+            ctl.paused = true;
+            schedule(0);
+            if (c.type === "quarantine") {
+                ctl.quarantined = true; // guarded tools are blocked here too, even if the server can't be reached
+                hook("quarantine", run, c);
+            }
+        }
+        else if (c.type === "resume") {
+            ctl.paused = ctl.quarantined = false; // releasing a quarantine resumes its runs
+        }
+        else if (c.type === "limits") {
+            for (const [wire, field] of Object.entries(LIMITS)) {
+                if (c[wire] !== undefined && c[wire] !== null)
+                    run[field] = c[wire]; // eslint-disable-line @typescript-eslint/no-explicit-any
+            }
+        }
+        else if (c.type === "approval") {
+            if (ctl.approvals.has(c.approval_id)) {
+                ctl.approvals.set(c.approval_id, { granted: !!c.granted, by: c.by ?? null, note: c.note ?? null, amountUsd: c.amount_usd ?? null });
+            }
+        }
+        else {
+            continue; // unknown: ignored, and not acknowledged
+        }
+        if (c.id && !ctl.acked.has(c.id)) {
+            ctl.acked.add(c.id);
+            ack({ run_id: run.runId, id: c.id, type: c.type, received_at: Date.now() / 1000 });
+        }
+    }
+}
+// ── Acknowledgements and containment hooks ────────────────────────────────────
+function ack(entry) {
+    acks.push(entry);
+    schedule(0); // send it now, not at the next interval
+}
+function hook(kind, run, c) {
+    const fn = hooks[kind];
+    if (!fn)
+        return;
+    if (kind === "quarantine") {
+        const key = c.id ?? `run:${run.runId}`; // every server that sends quarantine gives it an id
+        if (hooked.has(key))
+            return; // once per process per quarantine
+        hooked.add(key);
+    }
+    const event = { type: kind, runId: run.runId, agentName: run.agentName, id: c.id ?? null, by: c.by ?? null, reason: c.reason ?? null };
+    const p = runHook(fn, event).finally(() => runningHooks.delete(p));
+    runningHooks.add(p);
+}
+async function runHook(fn, event) {
+    const { errorText } = await import("./events.js");
+    let result = "ok", detail = null;
+    try {
+        const timedOut = Symbol("timeout");
+        const out = await Promise.race([
+            Promise.resolve().then(() => fn(event)),
+            new Promise((ok) => setTimeout(ok, HOOK_TIMEOUT_MS, timedOut).unref()), // ponytail: a hung hook can't be stopped; it's reported and left running
+        ]);
+        if (out === timedOut)
+            result = "timeout";
+    }
+    catch (e) {
+        [result, detail] = ["failed", errorText(e).slice(0, 300)];
+    }
+    if (result !== "ok")
+        console.warn(`agentfences: the on${event.type === "stop" ? "Stop" : "Quarantine"} hook ${result === "timeout" ? "timed out" : `failed: ${detail}`}`);
+    if (event.id) {
+        ack({ run_id: event.runId, id: event.id, type: event.type, hook: result, ...(detail ? { detail } : {}), finished_at: Date.now() / 1000 });
+    }
+}
+/**
+ * Wait for running hooks, then send the acknowledgements still waiting. flush() calls it, and
+ * it runs before the process exits, so a script that ends right after a stop still finishes
+ * its containment, and says so.
+ */
+export async function drain(timeoutMs = HOOK_TIMEOUT_MS) {
+    if (runningHooks.size) {
+        await Promise.race([Promise.allSettled([...runningHooks]), new Promise((ok) => setTimeout(ok, timeoutMs).unref())]);
+    }
+    await sendAcks();
+}
+async function sendAcks() {
+    if (!acks.length || !client || !supported.heartbeat)
+        return;
+    const batch = acks;
+    acks = [];
+    const resp = await client.heartbeat([], batch).catch(() => ({ network_error: "heartbeat failed" }));
+    if (resp.network_error || (resp.ok === false && (resp.status ?? 500) >= 500))
+        acks = [...batch, ...acks];
+}
+// Node exits once nothing keeps it busy: beforeExit lets acks queued by a finished hook still go out.
+// One try per batch: a server that's gone mustn't keep the process alive by failing and requeueing forever.
+let triedAtExit = false;
+if (typeof process?.on === "function") { // edge runtimes have no process events: flush() still drains there
+    process.on("beforeExit", () => {
+        if (triedAtExit || !acks.length || !client)
+            return;
+        triedAtExit = true;
+        void sendAcks();
+    });
+}
+// ── Heartbeat ─────────────────────────────────────────────────────────────────
+const unseenStop = (r) => r.control.stopped && !r.control.stopSeen && !r.control.cancelled && r.control.onCancel !== null;
+const busy = () => [...live.values()].some((r) => r.control.paused || r.control.awaiting > 0 || unseenStop(r));
+const nextDelay = () => (busy() ? Math.min(FAST_MS, intervalMs, stopGraceMs ?? FAST_MS) : intervalMs); // faster while busy, never slower
+function schedule(delayMs) {
+    if (timer)
+        clearTimeout(timer);
+    timer = null;
+    if (!client || !supported.heartbeat || !(live.size || acks.length))
+        return;
+    timer = setTimeout(beat, delayMs);
+    timer.unref(); // the heartbeat never keeps the process alive on its own
+}
+/** Halt governed calls that haven't reached a checkpoint within stopGraceS of a stop. */
+function cancelOverdue() {
+    if (stopGraceMs === null)
+        return;
+    for (const r of live.values()) {
+        if (unseenStop(r) && Date.now() - r.control.stoppedAt >= stopGraceMs) {
+            r.control.cancelled = true;
+            r.control.onCancel();
+        }
+    }
+}
+async function beat() {
+    timer = null;
+    cancelOverdue();
+    if (beating || !client || !(live.size || acks.length))
+        return schedule(nextDelay());
+    beating = true;
+    const runs = [...live.values()], batch = acks;
+    acks = [];
+    try {
+        const resp = await client.heartbeat(runs.map((r) => ({ run_id: r.runId, iterations: r.iterations, spent_usd: r.costUsd,
+            tokens_used: r.tokensUsed, paused: r.control.paused, stopped: r.control.stopped })), batch);
+        if (resp.network_error || (resp.ok === false && !resp.unsupported)) {
+            if (resp.network_error || (resp.status ?? 500) >= 500)
+                acks = [...batch, ...acks]; // at least once; a 4xx won't get better
+        }
+        else if (resp.unsupported) {
+            unsupported("heartbeat", "the heartbeat", "a stop from the dashboard applies at the next checkpoint and pause isn't available");
+            return;
+        }
+        else {
+            for (const run of runs)
+                apply(run, resp.commands?.filter((c) => c.run_id === run.runId));
+        }
+    }
+    catch {
+        acks = [...batch, ...acks]; // a failed heartbeat is retried next time
+    }
+    finally {
+        beating = false;
+    }
+    schedule(nextDelay());
+}
+// ── Pausing ───────────────────────────────────────────────────────────────────
+/** Hold the agent at its checkpoint while its run is paused, up to pauseTimeoutS. */
+export async function waitIfPaused(run) {
+    const deadline = Date.now() + pauseTimeoutMs;
+    while (run.control.paused) {
+        if (Date.now() >= deadline) {
+            run.control.paused = false;
+            run.control.pauseExpired = true;
+            return;
+        }
+        await new Promise((ok) => setTimeout(ok, 200));
+    }
+}
+// ── Approvals ─────────────────────────────────────────────────────────────────
+/**
+ * Ask a person, through the Fences dashboard, to approve something, and wait for the answer:
+ *
+ *     const approval = await requestApproval("Refund $240 to order 1182?", { amountUsd: 240 });
+ *     if (!approval.granted) return `I didn't issue the refund: ${approval.note}`;
+ *
+ * If an amount is approved, the run's budget goes up by that much. Returns denied right away in
+ * local mode, outside a run, or when the server can't take requests, and denied after timeoutS
+ * (default 600) with no answer: it never hangs and never throws.
+ */
+export async function requestApproval(reason, options = {}) {
+    const { getActiveRun, recordSpan } = await import("./core.js");
+    const run = getActiveRun();
+    const timeoutS = options.timeoutS ?? 600, amountUsd = options.amountUsd ?? null;
+    if (!run)
+        return { granted: false, note: "requestApproval() was called outside a governed run" };
+    if (!client)
+        return { granted: false, note: "Local mode: there is no one to approve this request" };
+    if (!supported.approvals)
+        return { granted: false, note: "This Fences server doesn't support approvals" };
+    const approvalId = randomUUID(), started = performance.now();
+    // timeout_s lets the server expire the request when we stop waiting
+    const resp = await client.requestApproval(run.runId, { approval_id: approvalId, reason, amount_usd: amountUsd, timeout_s: timeoutS });
+    if (resp.unsupported) {
+        unsupported("approvals", "approval requests", "they are denied");
+        return { granted: false, note: "This Fences server doesn't support approvals" };
+    }
+    if (resp.network_error)
+        return { granted: false, note: "Couldn't reach Fences to ask for approval" };
+    run.control.approvals.set(approvalId, null);
+    run.control.awaiting += 1;
+    schedule(0); // poll fast while someone decides
+    const deadline = Date.now() + timeoutS * 1000;
+    while (run.control.approvals.get(approvalId) === null && Date.now() < deadline) {
+        await new Promise((ok) => setTimeout(ok, 100));
+    }
+    run.control.awaiting -= 1;
+    const answer = run.control.approvals.get(approvalId) ?? { granted: false, note: "No answer before the timeout" };
+    answer.approvalId = approvalId;
+    run.control.approvals.delete(approvalId);
+    if (answer.granted && answer.amountUsd && run.budgetUsd !== null)
+        run.budgetUsd += answer.amountUsd; // an unlimited run stays unlimited
+    recordSpan("fences.approval", performance.now() - started, {
+        "fences.approval.id": approvalId, "fences.approval.reason": reason, "fences.approval.amount_usd": amountUsd,
+        "fences.approval.granted": answer.granted, "fences.approval.by": answer.by, "fences.approval.note": answer.note,
+        "fences.approval.granted_usd": answer.amountUsd,
+    });
+    return answer;
+}

package/dist/core.d.ts

@@ -1,4 +1,5 @@
 import { FencesClient } from "./client.js";
+import * as control from "./control.js";
 import * as events from "./events.js";
 import { type CustomPrice } from "./pricing.js";
 export interface CheckpointResult {
@@ -55,6 +56,19 @@ export declare class Run {
     lastBreach: string | null;
     exception?: events.ExceptionInfo;
     warned: boolean;
+    /** Live control from the dashboard (see control.ts). */
+    readonly control: control.Control;
+    /** Held by guarded tools that are running. */
+    reservedUsd: number;
+    private readonly abort;
+    /**
+     * Aborts when Fences halts the run after a stop it didn't reach a checkpoint for (see
+     * stopGraceS). Pass it to fetch and other cancellable work so a stuck run really stops:
+     *     await fetch(url, { signal: getActiveRun()?.signal });
+     */
+    get signal(): AbortSignal;
+    /** @internal */
+    _abort(reason: unknown): void;
     constructor(agentName: string, budgetUsd: number | null, maxIterations: number, maxDurationMs: number, maxTokens: number, context: Record<string, string>);
     get durationMs(): number;
 }
@@ -77,11 +91,31 @@ export interface InitOptions {
     release?: string;
     /** Sees every outgoing event and returns it (changed or not), or null to drop it. */
     redact?: events.RedactHook;
+    /** Seconds between heartbeats reporting live runs (cloud mode). Default 15. */
+    heartbeatS?: number;
+    /** How long a paused run waits at its checkpoint before stopping with breach "paused". Default 3600. */
+    pauseTimeoutS?: number;
+    /**
+     * If a run doesn't reach a checkpoint within this many seconds of a dashboard stop (say, it's
+     * stuck in a tool), the governed call rejects with FencesStop and the run's signal aborts.
+     * Default 30; null never does.
+     */
+    stopGraceS?: number | null;
+    /**
+     * Run in the agent's process when a stop arrives from the dashboard (once per run), to
+     * contain what Fences can't reach, e.g. revoke a credential the agent holds. Whether it
+     * worked, threw or ran past 30 seconds is reported to Fences.
+     */
+    onStop?: control.Hook;
+    /** The same, when the agent is quarantined (once per quarantine, however many runs it reaches). */
+    onQuarantine?: control.Hook;
 }
 /** Call once at startup, before any governed function runs. */
 export declare function init(options?: InitOptions): void;
 /** @internal For tests: point the SDK at a fake server client. */
 export declare function _setClient(c: FencesClient | null): void;
+/** @internal */
+export declare const _client: () => FencesClient | null;
 /**
  * Make each call of fn a governed run with these limits:
  *
@@ -112,7 +146,12 @@ export interface Extra {
  * Never throws for a breach. Outside a governed run it does nothing.
  */
 export declare function checkpoint(response?: unknown, extra?: Extra): Promise<CheckpointResult>;
-/** Wait up to timeoutMs for queued decisions and spans to reach the server. Call before a serverless handler returns. */
+/** @internal The breach the run is in by local rules, if any. */
+export declare function localBreach(run: Run): string | null;
+/**
+ * Wait up to timeoutMs for queued decisions and spans to reach the server, and for onStop and
+ * onQuarantine hooks to finish. Call before a serverless handler returns.
+ */
 export declare function flush(timeoutMs?: number): Promise<void>;
 /** Record the agent's reasoning at this step. Does nothing outside a governed run. */
 export declare function logDecision(reasoning: string, action?: string | null): void;

package/dist/core.js

@@ -1,6 +1,7 @@
 import { AsyncLocalStorage } from "node:async_hooks";
 import { randomUUID } from "node:crypto";
 import { FencesClient } from "./client.js";
+import * as control from "./control.js";
 import { AgentQuarantined, FencesStop } from "./errors.js";
 import * as events from "./events.js";
 import { costOf, setCustomPrices } from "./pricing.js";
@@ -57,6 +58,19 @@ export class Run {
     lastBreach = null;
     exception;
     warned = false;
+    /** Live control from the dashboard (see control.ts). */
+    control = control.newControl();
+    /** Held by guarded tools that are running. */
+    reservedUsd = 0;
+    abort = new AbortController();
+    /**
+     * Aborts when Fences halts the run after a stop it didn't reach a checkpoint for (see
+     * stopGraceS). Pass it to fetch and other cancellable work so a stuck run really stops:
+     *     await fetch(url, { signal: getActiveRun()?.signal });
+     */
+    get signal() { return this.abort.signal; }
+    /** @internal */
+    _abort(reason) { this.abort.abort(reason); }
     constructor(agentName, budgetUsd, maxIterations, maxDurationMs, maxTokens, context) {
         this.agentName = agentName;
         this.budgetUsd = budgetUsd;
@@ -83,15 +97,23 @@ export function init(options = {}) {
     failClosed = !!options.failClosed;
     if (localOnly) {
         client = null;
-        return;
     }
-    if (!options.apiKey) {
+    else if (!options.apiKey) {
         throw new Error("apiKey is required unless localOnly is set. Use init({ localOnly: true }) for local usage.");
     }
-    client = new FencesClient(options.apiKey, options.endpoint ?? "http://localhost:8000");
+    else {
+        client = new FencesClient(options.apiKey, options.endpoint ?? "http://localhost:8000");
+    }
+    control.configure(client, { heartbeatS: options.heartbeatS ?? 15, pauseTimeoutS: options.pauseTimeoutS ?? 3600,
+        stopGraceS: options.stopGraceS === undefined ? 30 : options.stopGraceS, onStop: options.onStop, onQuarantine: options.onQuarantine });
 }
 /** @internal For tests: point the SDK at a fake server client. */
-export function _setClient(c) { client = c; }
+export function _setClient(c) {
+    client = c;
+    control.configure(c, { heartbeatS: 15, pauseTimeoutS: 3600, stopGraceS: 30 });
+}
+/** @internal */
+export const _client = () => client;
 function requireInit() {
     if (!localOnly && !client) {
         throw new Error("Call agentfences.init() before using Fences. For local usage: init({ localOnly: true })");
@@ -118,15 +140,26 @@ export function governed(fn, options = {}) {
     return async (...args) => {
         requireInit();
         const run = await startRun(name, options);
+        // A stop the agent doesn't reach a checkpoint for within stopGraceS halts the call here
+        const halted = new Promise((_, reject) => {
+            run.control.onCancel = () => {
+                const stop = new FencesStop(finalResult(run));
+                run._abort(stop);
+                reject(stop);
+            };
+        });
+        control.register(run);
         let error, failed = false;
         try {
-            return await store.run(run, () => fn(...args));
+            // ponytail: JS can't stop running code; the agent's own work goes on unless it uses run.signal
+            return await Promise.race([store.run(run, () => fn(...args)), halted]);
         }
         catch (e) {
             [error, failed] = [e, true];
             throw e;
         }
         finally {
+            run.control.onCancel = null; // first, so a late cancel can't land after the call is over
             await endRun(run, ...outcome(run, failed, error));
         }
     };
@@ -135,7 +168,7 @@ function outcome(run, failed, error) {
     if (!failed)
         return [run.lastBreach ? "breached" : "success", null];
     if (error instanceof FencesStop)
-        return ["breached", null]; // a framework integration halted the agent
+        return ["breached", null]; // halted after a stop it missed (stopGraceS)
     run.exception = events.exceptionInfo(error);
     const e = run.exception;
     return ["error", e.message ? `${e.type}: ${e.message}` : e.type];
@@ -179,6 +212,7 @@ function noBudget(agentName, how) {
     events.warnOnce(`${agentName}:no_budget`, `${agentName} has no budget, so its spend isn't capped. ${how}`);
 }
 async function endRun(run, status, error) {
+    control.unregister(run);
     if (!client)
         return;
     // The run must end even if redaction drops its error details
@@ -186,6 +220,8 @@ async function endRun(run, status, error) {
     const body = { status, error: sent?.error ?? null };
     if (sent?.exception)
         body.exception = sent.exception;
+    if (status === "breached" && run.lastBreach)
+        body.breach = run.lastBreach; // matters for breaches the SDK decided
     await client.endRun(run.runId, body);
 }
 /**
@@ -214,9 +250,15 @@ export async function checkpoint(response, extra = {}) {
     const resp = client ? await client.checkpoint(run.runId, {
         cost_delta_usd: stepCost, tokens_used: stepTokens, iterations: run.iterations, duration_ms: run.durationMs
     }) : null;
-    return decide(run, resp);
+    const result = decide(run, resp);
+    if (run.control.paused && !result.breached) { // paused from the dashboard: wait here until resumed
+        await control.waitIfPaused(run);
+        return finalResult(run);
+    }
+    return result;
 }
-function localBreach(run) {
+/** @internal The breach the run is in by local rules, if any. */
+export function localBreach(run) {
     // Limits trip only once exceeded, same rule as the server; round away float drift (0.02*5 != 0.10)
     if (run.budgetUsd !== null && Math.round(run.costUsd * 1e9) / 1e9 > run.budgetUsd)
         return "budget_exceeded";
@@ -240,6 +282,7 @@ function decide(run, resp) {
         run.lastBreach = localBreach(run);
     }
     else {
+        control.apply(run, resp.commands);
         // The server is authoritative: adopt its totals and (on a breach) its current limits
         run.costUsd = resp.spent_usd ?? run.costUsd;
         run.iterations = resp.iterations ?? run.iterations;
@@ -251,6 +294,15 @@ function decide(run, resp) {
         // A fresh breach, or a 409 because the run is still fenced from an earlier one
         run.lastBreach = resp.ok ? null : (resp.breach ?? run.lastBreach ?? "limit_reached");
     }
+    return finalResult(run);
+}
+function finalResult(run) {
+    if (run.control.stopped) { // a stop from the dashboard sticks, whatever a later reply says
+        run.lastBreach = "stopped_by_user";
+        run.control.stopSeen = true;
+    }
+    else if (run.control.pauseExpired)
+        run.lastBreach = "paused";
     return run.lastBreach ? breachResult(run.lastBreach, run) : okResult(run.costUsd);
 }
 // ── Decision trail and spans ──────────────────────────────────────────────────
@@ -287,11 +339,15 @@ async function drain() {
         catch { /* never let delivery break the agent */ }
     }
 }
-/** Wait up to timeoutMs for queued decisions and spans to reach the server. Call before a serverless handler returns. */
+/**
+ * Wait up to timeoutMs for queued decisions and spans to reach the server, and for onStop and
+ * onQuarantine hooks to finish. Call before a serverless handler returns.
+ */
 export async function flush(timeoutMs = 5000) {
-    if (!draining)
-        return;
-    await Promise.race([draining, new Promise((r) => setTimeout(r, timeoutMs).unref())]);
+    const deadline = Date.now() + timeoutMs;
+    if (draining)
+        await Promise.race([draining, new Promise((r) => setTimeout(r, timeoutMs).unref())]);
+    await control.drain(Math.max(0, deadline - Date.now()));
 }
 /** Record the agent's reasoning at this step. Does nothing outside a governed run. */
 export function logDecision(reasoning, action = null) {

package/dist/errors.d.ts

@@ -11,8 +11,19 @@ export declare class AgentQuarantined extends FencesError {
     constructor(agentName: string, detail?: string);
 }
 /**
- * Thrown by framework integrations when a limit is crossed, because a framework callback
- * can't hand a result back to the agent. Carries the same fields as a breached CheckpointResult.
+ * Thrown instead of running a guarded tool (tool(fn, { guard: true })) that Fences didn't
+ * allow: the run is stopped, over budget, unapproved or quarantined, or Fences couldn't be
+ * reached. The tool's code never ran. reason says why; breachType is set when a limit is the cause.
+ */
+export declare class ToolBlocked extends FencesError {
+    readonly tool: string;
+    readonly reason: string;
+    readonly breachType: string | null;
+    constructor(tool: string, reason: string, breachType?: string | null);
+}
+/**
+ * Thrown when a run is halted from outside the agent's own code: a governed call stuck after a
+ * dashboard stop (see stopGraceS). Carries the same fields as a breached CheckpointResult.
  */
 export declare class FencesStop extends FencesError {
     readonly result: CheckpointResult;

package/dist/errors.js

@@ -17,8 +17,24 @@ export class AgentQuarantined extends FencesError {
     }
 }
 /**
- * Thrown by framework integrations when a limit is crossed, because a framework callback
- * can't hand a result back to the agent. Carries the same fields as a breached CheckpointResult.
+ * Thrown instead of running a guarded tool (tool(fn, { guard: true })) that Fences didn't
+ * allow: the run is stopped, over budget, unapproved or quarantined, or Fences couldn't be
+ * reached. The tool's code never ran. reason says why; breachType is set when a limit is the cause.
+ */
+export class ToolBlocked extends FencesError {
+    tool;
+    reason;
+    breachType;
+    constructor(tool, reason, breachType = null) {
+        super(`Fences blocked ${tool}: ${reason}`);
+        this.tool = tool;
+        this.reason = reason;
+        this.breachType = breachType;
+    }
+}
+/**
+ * Thrown when a run is halted from outside the agent's own code: a governed call stuck after a
+ * dashboard stop (see stopGraceS). Carries the same fields as a breached CheckpointResult.
  */
 export class FencesStop extends FencesError {
     result;

package/dist/index.d.ts

@@ -3,7 +3,10 @@ export type { CheckpointResult, InitOptions, Limits, Extra, Span } from "./core.
 export { context } from "./events.js";
 export type { RedactHook, Event } from "./events.js";
 export { tool } from "./tools.js";
+export type { GuardedToolOptions } from "./tools.js";
+export { requestApproval } from "./control.js";
+export type { Approval, ControlEvent, Hook } from "./control.js";
 export { priceOf } from "./pricing.js";
 export type { CustomPrice } from "./pricing.js";
-export { FencesError, FencesAuthError, AgentQuarantined, FencesStop } from "./errors.js";
+export { FencesError, FencesAuthError, AgentQuarantined, FencesStop, ToolBlocked } from "./errors.js";
 export { VERSION } from "./version.js";

package/dist/index.js

@@ -1,6 +1,7 @@
 export { init, governed, checkpoint, logDecision, flush, getActiveRun, Run } from "./core.js";
 export { context } from "./events.js";
 export { tool } from "./tools.js";
+export { requestApproval } from "./control.js";
 export { priceOf } from "./pricing.js";
-export { FencesError, FencesAuthError, AgentQuarantined, FencesStop } from "./errors.js";
+export { FencesError, FencesAuthError, AgentQuarantined, FencesStop, ToolBlocked } from "./errors.js";
 export { VERSION } from "./version.js";

package/dist/prices.generated.d.ts

@@ -8,4 +8,5 @@ export interface Rates {
 export interface PriceEntry extends Rates {
     above?: number;
     tier?: Rates;
+    max_out?: number;
 }

package/dist/prices.generated.js

@@ -1,3 +1,3 @@
 // Generated by scripts/prices.mjs from sdk/agentfences/prices.json. Do not edit.
-// LiteLLM model_prices_and_context_window.json, MIT License, Copyright (c) 2023 Berri AI, fetched 2026-10-09
-export const PRICES = { "chat-latest": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7 }, "claude-fable-5": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125 }, "claude-fable-5-1": { "in": 0.00001, "out": 0.00005, "cache_read": 2.5e-7, "cache_write": 0.0000125 }, "claude-haiku-4-5": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7, "cache_write": 0.00000125 }, "claude-haiku-4-5-20251001": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7, "cache_write": 0.00000125 }, "claude-haiku-5-5": { "in": 1e-7, "out": 5e-7, "cache_read": 1e-8, "cache_write": 1.25e-7 }, "claude-mythos-5": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125 }, "claude-mythos-5-1": { "in": 0.00001, "out": 0.00005, "cache_read": 2.5e-7, "cache_write": 0.0000125 }, "claude-mythos-preview": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125 }, "claude-opus-4-5": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-5-20251101": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-6": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-6-20260205": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-7": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-7-20260416": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-4-8": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-5": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625 }, "claude-opus-5-5": { "in": 0.000004, "out": 0.00002, "cache_read": 2e-7, "cache_write": 0.000005 }, "claude-sonnet-4-5": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375 }, "claude-sonnet-4-5-20250929": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375 }, "claude-sonnet-4-6": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375 }, "claude-sonnet-5": { "in": 0.000002, "out": 0.00001, "cache_read": 2e-7, "cache_write": 0.0000025 }, "claude-sonnet-5-5": { "in": 0.000002, "out": 0.00001, "cache_read": 1e-7, "cache_write": 0.0000025 }, "codestral-2508": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8 }, "codestral-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8 }, "codestral-mamba-latest": { "in": 2.5e-7, "out": 2.5e-7, "cache_read": 2.5e-8 }, "computer-use-preview": { "in": 0.000003, "out": 0.000012 }, "daybreak-blue-latest": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "daybreak-red-latest": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "deep-research-max-preview-04-2026": { "in": 0.000002, "out": 0.000012 }, "deep-research-preview-04-2026": { "in": 0.000002, "out": 0.000012 }, "deep-research-pro-preview-12-2025": { "in": 0.000002, "out": 0.000012 }, "deepseek-chat": { "in": 2.8e-7, "out": 4.2e-7, "cache_read": 2.8e-8 }, "deepseek-coder": { "in": 1.4e-7, "out": 2.8e-7, "cache_read": 1.4e-8 }, "deepseek-flash": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0 }, "deepseek-r1": { "in": 5.5e-7, "out": 0.00000219, "cache_read": 1.4e-7 }, "deepseek-reasoner": { "in": 2.8e-7, "out": 4.2e-7, "cache_read": 2.8e-8 }, "deepseek-v3": { "in": 2.7e-7, "out": 0.0000011, "cache_read": 7e-8, "cache_write": 0 }, "deepseek-v3.2": { "in": 2.8e-7, "out": 4e-7, "cache_read": 2.8e-8 }, "deepseek-v4-flash": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0 }, "deepseek-v4-flash-vision-exp": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0 }, "deepseek-v4-pro": { "in": 0.00000132, "out": 0.00000396, "cache_read": 4.4e-8, "cache_write": 0 }, "devstral-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8 }, "devstral-medium-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8 }, "devstral-small-latest": { "in": 1e-7, "out": 3e-7, "cache_read": 1e-8 }, "ft:gpt-3.5-turbo": { "in": 0.000003, "out": 0.000006 }, "ft:gpt-3.5-turbo-0125": { "in": 0.000003, "out": 0.000006 }, "ft:gpt-3.5-turbo-0613": { "in": 0.000003, "out": 0.000006 }, "ft:gpt-3.5-turbo-1106": { "in": 0.000003, "out": 0.000006 }, "ft:gpt-4-0613": { "in": 0.00003, "out": 0.00006 }, "ft:gpt-4.1-2025-04-14": { "in": 0.000003, "out": 0.000012, "cache_read": 7.5e-7 }, "ft:gpt-4.1-mini-2025-04-14": { "in": 8e-7, "out": 0.0000032, "cache_read": 2e-7 }, "ft:gpt-4.1-nano-2025-04-14": { "in": 2e-7, "out": 8e-7, "cache_read": 5e-8 }, "ft:gpt-4o-2024-08-06": { "in": 0.00000375, "out": 0.000015, "cache_read": 0.000001875 }, "ft:gpt-4o-2024-11-20": { "in": 0.00000375, "out": 0.000015, "cache_write": 0.000001875 }, "ft:gpt-4o-mini-2024-07-18": { "in": 3e-7, "out": 0.0000012, "cache_read": 1.5e-7 }, "ft:o4-mini-2025-04-16": { "in": 0.000004, "out": 0.000016, "cache_read": 0.000001 }, "gemini-2.5-computer-use-preview-10-2025": { "in": 0.00000125, "out": 0.00001, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000015 } }, "gemini-2.5-flash": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8 }, "gemini-2.5-flash-lite": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8 }, "gemini-2.5-flash-lite-preview-09-2025": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8 }, "gemini-2.5-flash-preview-09-2025": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8 }, "gemini-2.5-pro": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7 } }, "gemini-2.5-pro-preview-tts": { "in": 0.000001, "out": 0.00002, "cache_read": 1.25e-7 }, "gemini-3-flash-preview": { "in": 5e-7, "out": 0.000003, "cache_read": 5e-8 }, "gemini-3.1-flash-lite": { "in": 2.5e-7, "out": 0.0000015, "cache_read": 2.5e-8 }, "gemini-3.1-flash-lite-preview": { "in": 2.5e-7, "out": 0.0000015, "cache_read": 2.5e-8 }, "gemini-3.1-pro-preview": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-3.1-pro-preview-customtools": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-3.5-flash": { "in": 0.0000015, "out": 0.000009, "cache_read": 1.5e-7 }, "gemini-3.5-flash-lite": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8 }, "gemini-3.6-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8 }, "gemini-3.7-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8 }, "gemini-3.8-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8 }, "gemini-3.8-flash-cyber": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "gemini-exp-1114": { "in": 0, "out": 0 }, "gemini-exp-1206": { "in": 0, "out": 0 }, "gemini-flash-latest": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8 }, "gemini-flash-lite-latest": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8 }, "gemini-gemma-2-27b-it": { "in": 3.5e-7, "out": 0.00000105 }, "gemini-gemma-2-9b-it": { "in": 3.5e-7, "out": 0.00000105 }, "gemini-omni-1.1-flash": { "in": 0.0000015, "out": 0.000009 }, "gemini-omni-flash-preview": { "in": 0.0000015, "out": 0.000009 }, "gemini-pro-latest": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-robotics-er-1.5-preview": { "in": 3e-7, "out": 0.0000025, "cache_read": 0 }, "gemini-robotics-er-2-preview": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7 }, "gemini-robotics-er-2-streaming-preview": { "in": 0.000001, "out": 0.000005 }, "gemma-3-27b-it": { "in": 0, "out": 0 }, "gemma-4-26b-a4b-it": { "in": 0, "out": 0 }, "gemma-4-31b-it": { "in": 0, "out": 0 }, "glm-5-2": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7 }, "gpt-3.5-turbo": { "in": 5e-7, "out": 0.0000015 }, "gpt-3.5-turbo-0125": { "in": 5e-7, "out": 0.0000015 }, "gpt-3.5-turbo-1106": { "in": 0.000001, "out": 0.000002 }, "gpt-3.5-turbo-16k": { "in": 0.000003, "out": 0.000004 }, "gpt-4": { "in": 0.00003, "out": 0.00006 }, "gpt-4-0613": { "in": 0.00003, "out": 0.00006 }, "gpt-4-1106-preview": { "in": 0.00001, "out": 0.00003 }, "gpt-4-turbo": { "in": 0.00001, "out": 0.00003 }, "gpt-4-turbo-2024-04-09": { "in": 0.00001, "out": 0.00003 }, "gpt-4.1": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7 }, "gpt-4.1-2025-04-14": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7 }, "gpt-4.1-mini": { "in": 4e-7, "out": 0.0000016, "cache_read": 1e-7 }, "gpt-4.1-mini-2025-04-14": { "in": 4e-7, "out": 0.0000016, "cache_read": 1e-7 }, "gpt-4.1-nano": { "in": 1e-7, "out": 4e-7, "cache_read": 2.5e-8 }, "gpt-4.1-nano-2025-04-14": { "in": 1e-7, "out": 4e-7, "cache_read": 2.5e-8 }, "gpt-4o": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125 }, "gpt-4o-2024-05-13": { "in": 0.000005, "out": 0.000015 }, "gpt-4o-2024-08-06": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125 }, "gpt-4o-2024-11-20": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125 }, "gpt-4o-audio-preview-2024-12-17": { "in": 0.0000025, "out": 0.00001 }, "gpt-4o-audio-preview-2025-06-03": { "in": 0.0000025, "out": 0.00001 }, "gpt-4o-mini": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8 }, "gpt-4o-mini-2024-07-18": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8 }, "gpt-4o-mini-audio-preview-2024-12-17": { "in": 1.5e-7, "out": 6e-7 }, "gpt-4o-mini-search-preview": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8 }, "gpt-4o-search-preview": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125 }, "gpt-5": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-2025-08-07": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-chat": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-chat-latest": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-codex": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-mini": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8 }, "gpt-5-mini-2025-08-07": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8 }, "gpt-5-nano": { "in": 5e-8, "out": 4e-7, "cache_read": 5e-9 }, "gpt-5-nano-2025-08-07": { "in": 5e-8, "out": 4e-7, "cache_read": 5e-9 }, "gpt-5-pro": { "in": 0.000015, "out": 0.00012 }, "gpt-5-pro-2025-10-06": { "in": 0.000015, "out": 0.00012 }, "gpt-5-search-api": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5-search-api-2025-10-14": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1-2025-11-13": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1-chat-latest": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1-codex": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1-codex-max": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7 }, "gpt-5.1-codex-mini": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8 }, "gpt-5.2": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.2-2025-12-11": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.2-chat-latest": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.2-codex": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.2-pro": { "in": 0.000021, "out": 0.000168 }, "gpt-5.2-pro-2025-12-11": { "in": 0.000021, "out": 0.000168 }, "gpt-5.3-chat-latest": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.3-codex": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7 }, "gpt-5.4": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7, "above": 272000, "tier": { "in": 0.000005, "out": 0.0000225, "cache_read": 5e-7 } }, "gpt-5.4-2026-03-05": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7, "above": 272000, "tier": { "in": 0.000005, "out": 0.0000225, "cache_read": 5e-7 } }, "gpt-5.4-mini": { "in": 7.5e-7, "out": 0.0000045, "cache_read": 7.5e-8 }, "gpt-5.4-mini-2026-03-17": { "in": 7.5e-7, "out": 0.0000045, "cache_read": 7.5e-8 }, "gpt-5.4-nano": { "in": 2e-7, "out": 0.00000125, "cache_read": 2e-8 }, "gpt-5.4-nano-2026-03-17": { "in": 2e-7, "out": 0.00000125, "cache_read": 2e-8 }, "gpt-5.4-pro": { "in": 0.00003, "out": 0.00018, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.4-pro-2026-03-05": { "in": 0.00003, "out": 0.00018, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.5": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7, "above": 272000, "tier": { "in": 0.00001, "out": 0.000045, "cache_read": 0.000001 } }, "gpt-5.5-2026-04-23": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7, "above": 272000, "tier": { "in": 0.00001, "out": 0.000045, "cache_read": 0.000001 } }, "gpt-5.5-cyber": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125 }, "gpt-5.5-pro": { "in": 0.00003, "out": 0.00018, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.5-pro-2026-04-23": { "in": 0.00003, "out": 0.00018, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.6": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-5.6-cyber": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "gpt-5.6-luna": { "in": 2e-7, "out": 0.0000012, "cache_read": 2e-8, "cache_write": 2.5e-7, "above": 272000, "tier": { "in": 4e-7, "out": 0.0000018, "cache_read": 4e-8, "cache_write": 5e-7 } }, "gpt-5.6-sol": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-5.6-terra": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "cache_write": 0.0000025, "above": 272000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7, "cache_write": 0.000005 } }, "gpt-6-astra": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125, "above": 272000, "tier": { "in": 0.00002, "out": 0.000075, "cache_read": 0.000002, "cache_write": 0.000025 } }, "gpt-6-luna": { "in": 1e-7, "out": 5e-7, "cache_read": 1e-8, "cache_write": 1.25e-7, "above": 272000, "tier": { "in": 2e-7, "out": 7.5e-7, "cache_read": 2e-8, "cache_write": 2.5e-7 } }, "gpt-6-sol": { "in": 0.000002, "out": 0.00001, "cache_read": 2e-7, "cache_write": 0.0000025, "above": 272000, "tier": { "in": 0.000004, "out": 0.000015, "cache_read": 4e-7, "cache_write": 0.000005 } }, "gpt-6.1-sol": { "in": 0.000002, "out": 0.00001, "cache_read": 1e-7, "cache_write": 0.0000025, "above": 272000, "tier": { "in": 0.000004, "out": 0.000015, "cache_read": 2e-7, "cache_write": 0.000005 } }, "gpt-audio": { "in": 0.0000025, "out": 0.00001 }, "gpt-audio-1.5": { "in": 0.0000025, "out": 0.00001 }, "gpt-audio-2025-08-28": { "in": 0.0000025, "out": 0.00001 }, "gpt-audio-mini": { "in": 6e-7, "out": 0.0000024 }, "gpt-audio-mini-2025-12-15": { "in": 6e-7, "out": 0.0000024 }, "gpt-daybreak-blue-latest": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-daybreak-red-latest": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "gpt-oss-120b": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8 }, "gpt-oss-20b": { "in": 7.5e-8, "out": 3e-7, "cache_read": 3.75e-8 }, "gpt-oss-safeguard-20b": { "in": 7.5e-8, "out": 3e-7, "cache_read": 3.7e-8 }, "gpt-rosalind-discovery": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7 }, "gpt-rosalind-research": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7 }, "grok-4.20": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-non-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-beta-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-experimental-beta-0304": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-experimental-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning-gv2": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning-gv2": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.3": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.3-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.5": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-4.5-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-4.6": { "in": 0.000002, "out": 0.000006, "cache_read": 5e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 0.000001 } }, "grok-4.7": { "in": 0.000002, "out": 0.000006, "cache_read": 5e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 0.000001 } }, "grok-build-0.1": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-build-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-code-fast": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-code-fast-1": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-code-fast-1-0825": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "labs-leanstral-1-5": { "in": 0, "out": 0 }, "labs-leanstral-1-5-1": { "in": 0, "out": 0 }, "learnlm-1.5-pro-experimental": { "in": 0, "out": 0 }, "llama-guard-3-8b": { "in": 2e-7, "out": 2e-7 }, "llama-prompt-guard-2-22m": { "in": 3e-8, "out": 3e-8 }, "llama-prompt-guard-2-86m": { "in": 4e-8, "out": 4e-8 }, "lyria-3-clip-preview": { "in": 0, "out": 0 }, "lyria-3-pro-preview": { "in": 0, "out": 0 }, "lyria-3.5": { "in": 0, "out": 0 }, "lyria-3.5-clip-preview": { "in": 0, "out": 0 }, "lyria-3.5-pro-preview": { "in": 0, "out": 0 }, "lyria-realtime-exp": { "in": 0, "out": 0 }, "magistral-medium-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "magistral-small-latest": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8 }, "ministral-14b-2512": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8 }, "ministral-14b-latest": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8 }, "ministral-3-14b-2512": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8 }, "ministral-3-3b-2512": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8 }, "ministral-3-8b-2512": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8 }, "ministral-3b-2512": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8 }, "ministral-3b-latest": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8 }, "ministral-8b-2512": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8 }, "ministral-8b-latest": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8 }, "mistral-code-agent-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8 }, "mistral-code-fim-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8 }, "mistral-code-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8 }, "mistral-large-2512": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8 }, "mistral-large-3": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8 }, "mistral-large-4": { "in": 6.8e-7, "out": 0.00000209, "cache_read": 6.8e-8 }, "mistral-large-4-0": { "in": 6.8e-7, "out": 0.00000209, "cache_read": 6.8e-8 }, "mistral-large-latest": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8 }, "mistral-medium": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-medium-2604": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-medium-3": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-medium-3-5": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-medium-3.5": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-medium-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-small": { "in": 1e-7, "out": 3e-7, "cache_read": 1e-8 }, "mistral-small-2603": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8 }, "mistral-small-latest": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8 }, "mistral-tiny": { "in": 2.5e-7, "out": 2.5e-7, "cache_read": 2.5e-8 }, "mistral-vibe-cli-fast": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8 }, "mistral-vibe-cli-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "mistral-vibe-cli-with-tools": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7 }, "o1": { "in": 0.000015, "out": 0.00006, "cache_read": 0.0000075 }, "o1-2024-12-17": { "in": 0.000015, "out": 0.00006, "cache_read": 0.0000075 }, "o1-pro": { "in": 0.00015, "out": 0.0006 }, "o1-pro-2025-03-19": { "in": 0.00015, "out": 0.0006 }, "o3": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7 }, "o3-2025-04-16": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7 }, "o3-deep-research": { "in": 0.00001, "out": 0.00004, "cache_read": 0.0000025 }, "o3-mini": { "in": 0.0000011, "out": 0.0000044, "cache_read": 5.5e-7 }, "o3-mini-2025-01-31": { "in": 0.0000011, "out": 0.0000044, "cache_read": 5.5e-7 }, "o3-pro": { "in": 0.00002, "out": 0.00008 }, "o3-pro-2025-06-10": { "in": 0.00002, "out": 0.00008 }, "o4-mini": { "in": 0.0000011, "out": 0.0000044, "cache_read": 2.75e-7 }, "o4-mini-2025-04-16": { "in": 0.0000011, "out": 0.0000044, "cache_read": 2.75e-7 }, "o4-mini-deep-research": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7 }, "open-mistral-nemo": { "in": 3e-7, "out": 3e-7, "cache_read": 3e-8 }, "pixtral-large-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 2e-7 }, "qwen3.8-27b": { "in": 8e-7, "out": 0.000004 }, "voxtral-small-2507": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8 }, "voxtral-small-latest": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8 }, "zai-glm-5": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7 }, "zai-glm-5-2": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7 }, "zai-glm-5-3": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7 }, "zai-glm-latest": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7 } };
+// LiteLLM model_prices_and_context_window.json, MIT License, Copyright (c) 2023 Berri AI, fetched 2026-10-13
+export const PRICES = { "chat-latest": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7, "max_out": 128000 }, "claude-fable-5": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125, "max_out": 128000 }, "claude-fable-5-1": { "in": 0.00001, "out": 0.00005, "cache_read": 2.5e-7, "cache_write": 0.0000125, "max_out": 128000 }, "claude-haiku-4-5": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7, "cache_write": 0.00000125, "max_out": 64000 }, "claude-haiku-4-5-20251001": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7, "cache_write": 0.00000125, "max_out": 64000 }, "claude-haiku-5-5": { "in": 1e-7, "out": 5e-7, "cache_read": 1e-8, "cache_write": 1.25e-7, "max_out": 128000 }, "claude-mythos-5": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125, "max_out": 128000 }, "claude-mythos-5-1": { "in": 0.00001, "out": 0.00005, "cache_read": 2.5e-7, "cache_write": 0.0000125, "max_out": 128000 }, "claude-mythos-preview": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125, "max_out": 128000 }, "claude-opus-4-5": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 64000 }, "claude-opus-4-5-20251101": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 64000 }, "claude-opus-4-6": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-4-6-20260205": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-4-7": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-4-7-20260416": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-4-8": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-5": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7, "cache_write": 0.00000625, "max_out": 128000 }, "claude-opus-5-5": { "in": 0.000004, "out": 0.00002, "cache_read": 2e-7, "cache_write": 0.000005, "max_out": 128000 }, "claude-sonnet-4-5": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375, "max_out": 64000 }, "claude-sonnet-4-5-20250929": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375, "max_out": 64000 }, "claude-sonnet-4-6": { "in": 0.000003, "out": 0.000015, "cache_read": 3e-7, "cache_write": 0.00000375, "max_out": 128000 }, "claude-sonnet-5": { "in": 0.000002, "out": 0.00001, "cache_read": 2e-7, "cache_write": 0.0000025, "max_out": 128000 }, "claude-sonnet-5-5": { "in": 0.000002, "out": 0.00001, "cache_read": 1e-7, "cache_write": 0.0000025, "max_out": 128000 }, "codestral-2508": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8, "max_out": 128000 }, "codestral-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8, "max_out": 128000 }, "codestral-mamba-latest": { "in": 2.5e-7, "out": 2.5e-7, "cache_read": 2.5e-8, "max_out": 256000 }, "computer-use-preview": { "in": 0.000003, "out": 0.000012, "max_out": 1024 }, "computer-use-preview-2025-03-11": { "in": 0.000003, "out": 0.000012, "max_out": 1024 }, "daybreak-blue-latest": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "max_out": 128000, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "daybreak-red-latest": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "max_out": 128000, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "deep-research-max-preview-04-2026": { "in": 0.000002, "out": 0.000012, "max_out": 65536 }, "deep-research-preview-04-2026": { "in": 0.000002, "out": 0.000012, "max_out": 65536 }, "deep-research-pro-preview-12-2025": { "in": 0.000002, "out": 0.000012, "max_out": 65536 }, "deepseek-chat": { "in": 2.8e-7, "out": 4.2e-7, "cache_read": 2.8e-8, "max_out": 8192 }, "deepseek-coder": { "in": 1.4e-7, "out": 2.8e-7, "cache_read": 1.4e-8, "max_out": 4096 }, "deepseek-flash": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0, "max_out": 393216 }, "deepseek-r1": { "in": 5.5e-7, "out": 0.00000219, "cache_read": 1.4e-7, "max_out": 8192 }, "deepseek-reasoner": { "in": 2.8e-7, "out": 4.2e-7, "cache_read": 2.8e-8, "max_out": 65536 }, "deepseek-v3": { "in": 2.7e-7, "out": 0.0000011, "cache_read": 7e-8, "cache_write": 0, "max_out": 8192 }, "deepseek-v3.2": { "in": 2.8e-7, "out": 4e-7, "cache_read": 2.8e-8, "max_out": 163840 }, "deepseek-v4-flash": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0, "max_out": 393216 }, "deepseek-v4-flash-vision-exp": { "in": 3e-7, "out": 0.0000012, "cache_read": 6e-9, "cache_write": 0, "max_out": 393216 }, "deepseek-v4-pro": { "in": 0.00000132, "out": 0.00000396, "cache_read": 4.4e-8, "cache_write": 0, "max_out": 393216 }, "devstral-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8, "max_out": 256000 }, "devstral-medium-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8, "max_out": 256000 }, "devstral-small-latest": { "in": 1e-7, "out": 3e-7, "cache_read": 1e-8, "max_out": 256000 }, "ft:gpt-3.5-turbo": { "in": 0.000003, "out": 0.000006, "max_out": 4096 }, "ft:gpt-3.5-turbo-0125": { "in": 0.000003, "out": 0.000006, "max_out": 4096 }, "ft:gpt-3.5-turbo-0613": { "in": 0.000003, "out": 0.000006, "max_out": 4096 }, "ft:gpt-3.5-turbo-1106": { "in": 0.000003, "out": 0.000006, "max_out": 4096 }, "ft:gpt-4-0613": { "in": 0.00003, "out": 0.00006, "max_out": 4096 }, "ft:gpt-4.1-2025-04-14": { "in": 0.000003, "out": 0.000012, "cache_read": 7.5e-7, "max_out": 32768 }, "ft:gpt-4.1-mini-2025-04-14": { "in": 8e-7, "out": 0.0000032, "cache_read": 2e-7, "max_out": 32768 }, "ft:gpt-4.1-nano-2025-04-14": { "in": 2e-7, "out": 8e-7, "cache_read": 5e-8, "max_out": 32768 }, "ft:gpt-4o-2024-08-06": { "in": 0.00000375, "out": 0.000015, "cache_read": 0.000001875, "max_out": 16384 }, "ft:gpt-4o-2024-11-20": { "in": 0.00000375, "out": 0.000015, "cache_write": 0.000001875, "max_out": 16384 }, "ft:gpt-4o-mini-2024-07-18": { "in": 3e-7, "out": 0.0000012, "cache_read": 1.5e-7, "max_out": 16384 }, "ft:o4-mini-2025-04-16": { "in": 0.000004, "out": 0.000016, "cache_read": 0.000001, "max_out": 100000 }, "gemini-2.5-computer-use-preview-10-2025": { "in": 0.00000125, "out": 0.00001, "max_out": 64000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000015 } }, "gemini-2.5-flash": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8, "max_out": 65536 }, "gemini-2.5-flash-lite": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8, "max_out": 65536 }, "gemini-2.5-flash-lite-preview-09-2025": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8, "max_out": 65535 }, "gemini-2.5-flash-preview-09-2025": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8, "max_out": 65535 }, "gemini-2.5-pro": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 65536, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7 } }, "gemini-2.5-pro-preview-tts": { "in": 0.000001, "out": 0.00002, "cache_read": 1.25e-7, "max_out": 16384 }, "gemini-3-flash-preview": { "in": 5e-7, "out": 0.000003, "cache_read": 5e-8, "max_out": 65536 }, "gemini-3.1-flash-lite": { "in": 2.5e-7, "out": 0.0000015, "cache_read": 2.5e-8, "max_out": 65536 }, "gemini-3.1-flash-lite-preview": { "in": 2.5e-7, "out": 0.0000015, "cache_read": 2.5e-8, "max_out": 65536 }, "gemini-3.1-pro-preview": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "max_out": 65536, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-3.1-pro-preview-customtools": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "max_out": 65536, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-3.5-flash": { "in": 0.0000015, "out": 0.000009, "cache_read": 1.5e-7, "max_out": 65536 }, "gemini-3.5-flash-lite": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8, "max_out": 65536 }, "gemini-3.6-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8, "max_out": 65536 }, "gemini-3.7-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8, "max_out": 65536 }, "gemini-3.8-flash": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8, "max_out": 65536 }, "gemini-3.8-flash-cyber": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 65536 }, "gemini-4-argon": { "in": 0.000002, "out": 0.00001, "cache_read": 1e-7, "max_out": 65536 }, "gemini-exp-1114": { "in": 0, "out": 0, "max_out": 8192 }, "gemini-exp-1206": { "in": 0, "out": 0, "max_out": 8192 }, "gemini-flash-latest": { "in": 7.5e-7, "out": 0.00000375, "cache_read": 7.5e-8, "max_out": 65536 }, "gemini-flash-lite-latest": { "in": 3e-7, "out": 0.0000025, "cache_read": 3e-8, "max_out": 65536 }, "gemini-gemma-2-27b-it": { "in": 3.5e-7, "out": 0.00000105, "max_out": 8192 }, "gemini-gemma-2-9b-it": { "in": 3.5e-7, "out": 0.00000105, "max_out": 8192 }, "gemini-omni-1.1-flash": { "in": 0.0000015, "out": 0.000009, "max_out": 65536 }, "gemini-omni-flash-preview": { "in": 0.0000015, "out": 0.000009, "max_out": 65536 }, "gemini-pro-latest": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "max_out": 65536, "above": 200000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7 } }, "gemini-robotics-er-1.5-preview": { "in": 3e-7, "out": 0.0000025, "cache_read": 0, "max_out": 65535 }, "gemini-robotics-er-2-preview": { "in": 0.000001, "out": 0.000005, "cache_read": 1e-7, "max_out": 65536 }, "gemini-robotics-er-2-streaming-preview": { "in": 0.000001, "out": 0.000005, "max_out": 65536 }, "gemma-3-27b-it": { "in": 0, "out": 0, "max_out": 8192 }, "gemma-4-26b-a4b-it": { "in": 0, "out": 0, "max_out": 32768 }, "gemma-4-31b-it": { "in": 0, "out": 0, "max_out": 32768 }, "glm-5-2": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7, "max_out": 131072 }, "gpt-3.5-turbo": { "in": 5e-7, "out": 0.0000015, "max_out": 4096 }, "gpt-3.5-turbo-0125": { "in": 5e-7, "out": 0.0000015, "max_out": 4096 }, "gpt-3.5-turbo-1106": { "in": 0.000001, "out": 0.000002, "max_out": 4096 }, "gpt-3.5-turbo-16k": { "in": 0.000003, "out": 0.000004, "max_out": 4096 }, "gpt-4": { "in": 0.00003, "out": 0.00006, "max_out": 4096 }, "gpt-4-0613": { "in": 0.00003, "out": 0.00006, "max_out": 4096 }, "gpt-4-1106-preview": { "in": 0.00001, "out": 0.00003, "max_out": 4096 }, "gpt-4-turbo": { "in": 0.00001, "out": 0.00003, "max_out": 4096 }, "gpt-4-turbo-2024-04-09": { "in": 0.00001, "out": 0.00003, "max_out": 4096 }, "gpt-4.1": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 32768 }, "gpt-4.1-2025-04-14": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 32768 }, "gpt-4.1-mini": { "in": 4e-7, "out": 0.0000016, "cache_read": 1e-7, "max_out": 32768 }, "gpt-4.1-mini-2025-04-14": { "in": 4e-7, "out": 0.0000016, "cache_read": 1e-7, "max_out": 32768 }, "gpt-4.1-nano": { "in": 1e-7, "out": 4e-7, "cache_read": 2.5e-8, "max_out": 32768 }, "gpt-4.1-nano-2025-04-14": { "in": 1e-7, "out": 4e-7, "cache_read": 2.5e-8, "max_out": 32768 }, "gpt-4o": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125, "max_out": 16384 }, "gpt-4o-2024-05-13": { "in": 0.000005, "out": 0.000015, "max_out": 4096 }, "gpt-4o-2024-08-06": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125, "max_out": 16384 }, "gpt-4o-2024-11-20": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125, "max_out": 16384 }, "gpt-4o-audio-preview-2024-12-17": { "in": 0.0000025, "out": 0.00001, "max_out": 16384 }, "gpt-4o-audio-preview-2025-06-03": { "in": 0.0000025, "out": 0.00001, "max_out": 16384 }, "gpt-4o-mini": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8, "max_out": 16384 }, "gpt-4o-mini-2024-07-18": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8, "max_out": 16384 }, "gpt-4o-mini-audio-preview-2024-12-17": { "in": 1.5e-7, "out": 6e-7, "max_out": 16384 }, "gpt-4o-mini-search-preview": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8, "max_out": 16384 }, "gpt-4o-mini-search-preview-2025-03-11": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8, "max_out": 16384 }, "gpt-4o-search-preview": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125, "max_out": 16384 }, "gpt-4o-search-preview-2025-03-11": { "in": 0.0000025, "out": 0.00001, "cache_read": 0.00000125, "max_out": 16384 }, "gpt-5": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5-2025-08-07": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5-chat": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 16384 }, "gpt-5-chat-latest": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 16384 }, "gpt-5-codex": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5-mini": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8, "max_out": 128000 }, "gpt-5-mini-2025-08-07": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8, "max_out": 128000 }, "gpt-5-nano": { "in": 5e-8, "out": 4e-7, "cache_read": 5e-9, "max_out": 128000 }, "gpt-5-nano-2025-08-07": { "in": 5e-8, "out": 4e-7, "cache_read": 5e-9, "max_out": 128000 }, "gpt-5-pro": { "in": 0.000015, "out": 0.00012, "max_out": 272000 }, "gpt-5-pro-2025-10-06": { "in": 0.000015, "out": 0.00012, "max_out": 272000 }, "gpt-5-search-api": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5-search-api-2025-10-14": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5.1": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5.1-2025-11-13": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5.1-chat-latest": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 16384 }, "gpt-5.1-codex": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5.1-codex-max": { "in": 0.00000125, "out": 0.00001, "cache_read": 1.25e-7, "max_out": 128000 }, "gpt-5.1-codex-mini": { "in": 2.5e-7, "out": 0.000002, "cache_read": 2.5e-8, "max_out": 128000 }, "gpt-5.2": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 128000 }, "gpt-5.2-2025-12-11": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 128000 }, "gpt-5.2-chat-latest": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 16384 }, "gpt-5.2-codex": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 128000 }, "gpt-5.2-pro": { "in": 0.000021, "out": 0.000168, "max_out": 128000 }, "gpt-5.2-pro-2025-12-11": { "in": 0.000021, "out": 0.000168, "max_out": 128000 }, "gpt-5.3-chat-latest": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 16384 }, "gpt-5.3-codex": { "in": 0.00000175, "out": 0.000014, "cache_read": 1.75e-7, "max_out": 128000 }, "gpt-5.4": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7, "max_out": 128000, "above": 272000, "tier": { "in": 0.000005, "out": 0.0000225, "cache_read": 5e-7 } }, "gpt-5.4-2026-03-05": { "in": 0.0000025, "out": 0.000015, "cache_read": 2.5e-7, "max_out": 128000, "above": 272000, "tier": { "in": 0.000005, "out": 0.0000225, "cache_read": 5e-7 } }, "gpt-5.4-mini": { "in": 7.5e-7, "out": 0.0000045, "cache_read": 7.5e-8, "max_out": 128000 }, "gpt-5.4-mini-2026-03-17": { "in": 7.5e-7, "out": 0.0000045, "cache_read": 7.5e-8, "max_out": 128000 }, "gpt-5.4-nano": { "in": 2e-7, "out": 0.00000125, "cache_read": 2e-8, "max_out": 128000 }, "gpt-5.4-nano-2026-03-17": { "in": 2e-7, "out": 0.00000125, "cache_read": 2e-8, "max_out": 128000 }, "gpt-5.4-pro": { "in": 0.00003, "out": 0.00018, "max_out": 128000, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.4-pro-2026-03-05": { "in": 0.00003, "out": 0.00018, "max_out": 128000, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.5": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7, "max_out": 128000, "above": 272000, "tier": { "in": 0.00001, "out": 0.000045, "cache_read": 0.000001 } }, "gpt-5.5-2026-04-23": { "in": 0.000005, "out": 0.00003, "cache_read": 5e-7, "max_out": 128000, "above": 272000, "tier": { "in": 0.00001, "out": 0.000045, "cache_read": 0.000001 } }, "gpt-5.5-cyber": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125 }, "gpt-5.5-pro": { "in": 0.00003, "out": 0.00018, "max_out": 128000, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.5-pro-2026-04-23": { "in": 0.00003, "out": 0.00018, "max_out": 128000, "above": 272000, "tier": { "in": 0.00006, "out": 0.00027 } }, "gpt-5.6": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "max_out": 128000, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-5.6-cyber": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "max_out": 128000, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "gpt-5.6-luna": { "in": 2e-7, "out": 0.0000012, "cache_read": 2e-8, "cache_write": 2.5e-7, "max_out": 128000, "above": 272000, "tier": { "in": 4e-7, "out": 0.0000018, "cache_read": 4e-8, "cache_write": 5e-7 } }, "gpt-5.6-sol": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "max_out": 128000, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-5.6-terra": { "in": 0.000002, "out": 0.000012, "cache_read": 2e-7, "cache_write": 0.0000025, "max_out": 128000, "above": 272000, "tier": { "in": 0.000004, "out": 0.000018, "cache_read": 4e-7, "cache_write": 0.000005 } }, "gpt-6-astra": { "in": 0.00001, "out": 0.00005, "cache_read": 0.000001, "cache_write": 0.0000125, "max_out": 128000, "above": 272000, "tier": { "in": 0.00002, "out": 0.000075, "cache_read": 0.000002, "cache_write": 0.000025 } }, "gpt-6-luna": { "in": 1e-7, "out": 5e-7, "cache_read": 1e-8, "cache_write": 1.25e-7, "max_out": 128000, "above": 272000, "tier": { "in": 2e-7, "out": 7.5e-7, "cache_read": 2e-8, "cache_write": 2.5e-7 } }, "gpt-6-sol": { "in": 0.000002, "out": 0.00001, "cache_read": 2e-7, "cache_write": 0.0000025, "max_out": 128000, "above": 272000, "tier": { "in": 0.000004, "out": 0.000015, "cache_read": 4e-7, "cache_write": 0.000005 } }, "gpt-6.1-sol": { "in": 0.000002, "out": 0.00001, "cache_read": 1e-7, "cache_write": 0.0000025, "max_out": 128000, "above": 272000, "tier": { "in": 0.000004, "out": 0.000015, "cache_read": 2e-7, "cache_write": 0.000005 } }, "gpt-audio": { "in": 0.0000025, "out": 0.00001, "max_out": 16384 }, "gpt-audio-1.5": { "in": 0.0000025, "out": 0.00001, "max_out": 16384 }, "gpt-audio-2025-08-28": { "in": 0.0000025, "out": 0.00001, "max_out": 16384 }, "gpt-audio-mini": { "in": 6e-7, "out": 0.0000024, "max_out": 16384 }, "gpt-audio-mini-2025-10-06": { "in": 6e-7, "out": 0.0000024, "max_out": 16384 }, "gpt-audio-mini-2025-12-15": { "in": 6e-7, "out": 0.0000024, "max_out": 16384 }, "gpt-daybreak-blue-latest": { "in": 0.000004, "out": 0.00002, "cache_read": 4e-7, "cache_write": 0.000005, "max_out": 128000, "above": 272000, "tier": { "in": 0.000008, "out": 0.00003, "cache_read": 8e-7, "cache_write": 0.00001 } }, "gpt-daybreak-red-latest": { "in": 0.0000125, "out": 0.000075, "cache_read": 0.00000125, "cache_write": 0.000015625, "max_out": 128000, "above": 272000, "tier": { "in": 0.000025, "out": 0.0001125, "cache_read": 0.0000025, "cache_write": 0.00003125 } }, "gpt-oss-120b": { "in": 1.5e-7, "out": 6e-7, "cache_read": 7.5e-8, "max_out": 65536 }, "gpt-oss-20b": { "in": 7.5e-8, "out": 3e-7, "cache_read": 3.75e-8, "max_out": 65536 }, "gpt-oss-safeguard-20b": { "in": 7.5e-8, "out": 3e-7, "cache_read": 3.7e-8, "max_out": 65536 }, "gpt-rosalind-discovery": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7 }, "gpt-rosalind-research": { "in": 0.000005, "out": 0.000025, "cache_read": 5e-7 }, "grok-4.20": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-0309-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-0309-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-latest-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-beta-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-0304-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-non-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-experimental-beta-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-beta-0309": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-experimental-beta-0304": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-experimental-beta-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-multi-agent-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning-gv2": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-non-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning-gv2": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.20-reasoning-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.3": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.3-latest": { "in": 0.00000125, "out": 0.0000025, "cache_read": 2e-7, "max_out": 1000000, "above": 200000, "tier": { "in": 0.0000025, "out": 0.000005, "cache_read": 4e-7 } }, "grok-4.5": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "max_out": 500000, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-4.5-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "max_out": 500000, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-4.6": { "in": 0.000002, "out": 0.000006, "cache_read": 5e-7, "max_out": 500000, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 0.000001 } }, "grok-4.7": { "in": 0.000002, "out": 0.000006, "cache_read": 5e-7, "max_out": 500000, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 0.000001 } }, "grok-build-0.1": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "max_out": 256000, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-build-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 3e-7, "max_out": 500000, "above": 200000, "tier": { "in": 0.000004, "out": 0.000012, "cache_read": 6e-7 } }, "grok-code-fast": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "max_out": 256000, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-code-fast-1": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "max_out": 256000, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "grok-code-fast-1-0825": { "in": 0.000001, "out": 0.000002, "cache_read": 2e-7, "max_out": 256000, "above": 200000, "tier": { "in": 0.000002, "out": 0.000004, "cache_read": 4e-7 } }, "labs-leanstral-1-5": { "in": 0, "out": 0, "max_out": 131072 }, "labs-leanstral-1-5-1": { "in": 0, "out": 0, "max_out": 131072 }, "learnlm-1.5-pro-experimental": { "in": 0, "out": 0, "max_out": 8192 }, "llama-guard-3-8b": { "in": 2e-7, "out": 2e-7 }, "llama-prompt-guard-2-22m": { "in": 3e-8, "out": 3e-8, "max_out": 512 }, "llama-prompt-guard-2-86m": { "in": 4e-8, "out": 4e-8, "max_out": 512 }, "lyria-3-clip-preview": { "in": 0, "out": 0, "max_out": 8192 }, "lyria-3-pro-preview": { "in": 0, "out": 0, "max_out": 8192 }, "lyria-3.5": { "in": 0, "out": 0, "max_out": 65536 }, "lyria-3.5-clip-preview": { "in": 0, "out": 0, "max_out": 8192 }, "lyria-3.5-pro-preview": { "in": 0, "out": 0, "max_out": 8192 }, "lyria-realtime-exp": { "in": 0, "out": 0, "max_out": 65536 }, "magistral-medium-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "magistral-small-latest": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "ministral-14b-2512": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8, "max_out": 262144 }, "ministral-14b-latest": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8, "max_out": 262144 }, "ministral-3-14b-2512": { "in": 2e-7, "out": 2e-7, "cache_read": 2e-8, "max_out": 262144 }, "ministral-3-3b-2512": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8, "max_out": 131072 }, "ministral-3-8b-2512": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "ministral-3b-2512": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8, "max_out": 131072 }, "ministral-3b-latest": { "in": 1e-7, "out": 1e-7, "cache_read": 1e-8, "max_out": 131072 }, "ministral-8b-2512": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "ministral-8b-latest": { "in": 1.5e-7, "out": 1.5e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "mistral-code-agent-latest": { "in": 4e-7, "out": 0.000002, "cache_read": 4e-8, "max_out": 256000 }, "mistral-code-fim-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8, "max_out": 128000 }, "mistral-code-latest": { "in": 3e-7, "out": 9e-7, "cache_read": 3e-8, "max_out": 128000 }, "mistral-large-2512": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8, "max_out": 262144 }, "mistral-large-3": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8, "max_out": 262144 }, "mistral-large-4": { "in": 6.8e-7, "out": 0.00000209, "cache_read": 6.8e-8 }, "mistral-large-4-0": { "in": 6.8e-7, "out": 0.00000209, "cache_read": 6.8e-8 }, "mistral-large-latest": { "in": 5e-7, "out": 0.0000015, "cache_read": 5e-8, "max_out": 262144 }, "mistral-medium": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-medium-2604": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-medium-3": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-medium-3-5": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-medium-3.5": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-medium-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-small": { "in": 1e-7, "out": 3e-7, "cache_read": 1e-8, "max_out": 8191 }, "mistral-small-2603": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "mistral-small-latest": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "mistral-tiny": { "in": 2.5e-7, "out": 2.5e-7, "cache_read": 2.5e-8, "max_out": 8191 }, "mistral-vibe-cli-fast": { "in": 1.5e-7, "out": 6e-7, "cache_read": 1.5e-8, "max_out": 262144 }, "mistral-vibe-cli-latest": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "mistral-vibe-cli-with-tools": { "in": 0.0000015, "out": 0.0000075, "cache_read": 1.5e-7, "max_out": 262144 }, "o1": { "in": 0.000015, "out": 0.00006, "cache_read": 0.0000075, "max_out": 100000 }, "o1-2024-12-17": { "in": 0.000015, "out": 0.00006, "cache_read": 0.0000075, "max_out": 100000 }, "o1-pro": { "in": 0.00015, "out": 0.0006, "max_out": 100000 }, "o1-pro-2025-03-19": { "in": 0.00015, "out": 0.0006, "max_out": 100000 }, "o3": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 100000 }, "o3-2025-04-16": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 100000 }, "o3-deep-research": { "in": 0.00001, "out": 0.00004, "cache_read": 0.0000025, "max_out": 100000 }, "o3-deep-research-2025-06-26": { "in": 0.00001, "out": 0.00004, "cache_read": 0.0000025, "max_out": 100000 }, "o3-mini": { "in": 0.0000011, "out": 0.0000044, "cache_read": 5.5e-7, "max_out": 100000 }, "o3-mini-2025-01-31": { "in": 0.0000011, "out": 0.0000044, "cache_read": 5.5e-7, "max_out": 100000 }, "o3-pro": { "in": 0.00002, "out": 0.00008, "max_out": 100000 }, "o3-pro-2025-06-10": { "in": 0.00002, "out": 0.00008, "max_out": 100000 }, "o4-mini": { "in": 0.0000011, "out": 0.0000044, "cache_read": 2.75e-7, "max_out": 100000 }, "o4-mini-2025-04-16": { "in": 0.0000011, "out": 0.0000044, "cache_read": 2.75e-7, "max_out": 100000 }, "o4-mini-deep-research": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 100000 }, "o4-mini-deep-research-2025-06-26": { "in": 0.000002, "out": 0.000008, "cache_read": 5e-7, "max_out": 100000 }, "open-mistral-nemo": { "in": 3e-7, "out": 3e-7, "cache_read": 3e-8, "max_out": 128000 }, "pixtral-large-latest": { "in": 0.000002, "out": 0.000006, "cache_read": 2e-7, "max_out": 128000 }, "qwen3.8-27b": { "in": 8e-7, "out": 0.000004, "max_out": 16384 }, "voxtral-small-2507": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8, "max_out": 32768 }, "voxtral-small-latest": { "in": 1e-7, "out": 4e-7, "cache_read": 1e-8, "max_out": 32768 }, "zai-glm-5": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7, "max_out": 131072 }, "zai-glm-5-2": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7, "max_out": 131072 }, "zai-glm-5-3": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7, "max_out": 131072 }, "zai-glm-latest": { "in": 0.0000014, "out": 0.0000044, "cache_read": 1.4e-7, "max_out": 131072 } };

package/dist/tools.d.ts

@@ -1,15 +1,49 @@
 /** `{"query":"cats","limit":5}`: the arguments as compact JSON (one object argument on its own), capped. */
 export declare function argsSummary(args: unknown[]): string;
+interface ToolFields<A extends unknown[]> {
+    name?: string;
+    /** Reject with a TimeoutError if the call takes longer. JS can't stop the tool's code; pass run.signal to its fetches. */
+    timeoutS?: number;
+    /** Ask Fences before each call; it runs only if allowed. */
+    guard?: boolean;
+    /** What a call costs the run, reserved before and charged after: a number, or a function of the tool's arguments. */
+    costUsd?: number | ((...args: A) => number);
+    /** A person approves each call from the dashboard first. */
+    approve?: boolean;
+}
+/** Options that make a tool async: a guard (guard, costUsd or approve) or a timeout. */
+export type GuardedToolOptions<A extends unknown[]> = ToolFields<A> & ({
+    guard: true;
+} | {
+    costUsd: number | ((...args: A) => number);
+} | {
+    approve: true;
+} | {
+    timeoutS: number;
+});
 /**
  * Record every call of an agent tool on the active run:
  *
  *     const webSearch = tool(async (query: string) => { ... });
- *     const fetchPage = tool(fetchPageImpl, { name: "fetch" });
+ *     const fetchPage = tool(fetchPageImpl, { name: "fetch", timeoutS: 30 });
  *
  * Records the tool's name, a short summary of its arguments, whether it succeeded (and the
  * error if not) and how long it took. Errors still reach the caller; sync tools stay sync.
  * Outside a governed run it just calls the function.
+ *
+ * Guarded tools ask Fences before they run, for actions with consequences:
+ *
+ *     const issueRefund = tool(refund, { costUsd: (orderId, amount) => amount, approve: true });
+ *
+ * guard: true runs the tool only if the run isn't stopped, paused, over a limit or
+ * quarantined; otherwise it throws ToolBlocked and the tool's code never runs. It's blocked
+ * too if Fences can't be reached (guards fail closed). costUsd is reserved before the call,
+ * so parallel calls can't overspend together, and charged after (unless the tool threw; a
+ * timeout is charged, as it may have happened). approve: true asks a person first.
+ * Setting costUsd or approve guards the tool. A guarded or timed tool returns a promise.
  */
+export declare function tool<A extends unknown[], R>(fn: (...args: A) => R, options: GuardedToolOptions<A>): (...args: A) => Promise<Awaited<R>>;
 export declare function tool<A extends unknown[], R>(fn: (...args: A) => R, options?: {
     name?: string;
 }): (...args: A) => R;
+export {};

package/dist/tools.js

@@ -1,4 +1,8 @@
-import { getActiveRun } from "./core.js";
+import { randomUUID } from "node:crypto";
+import * as control from "./control.js";
+import { _client, getActiveRun, localBreach } from "./core.js";
+import { ToolBlocked } from "./errors.js";
+import * as events from "./events.js";
 import { MAX_ARGS, recordToolCall } from "./spans.js";
 /** `{"query":"cats","limit":5}`: the arguments as compact JSON (one object argument on its own), capped. */
 export function argsSummary(args) {
@@ -11,18 +15,117 @@ export function argsSummary(args) {
     }
     return text.length <= MAX_ARGS ? text : text.slice(0, MAX_ARGS - 1) + "…";
 }
-/**
- * Record every call of an agent tool on the active run:
- *
- *     const webSearch = tool(async (query: string) => { ... });
- *     const fetchPage = tool(fetchPageImpl, { name: "fetch" });
- *
- * Records the tool's name, a short summary of its arguments, whether it succeeded (and the
- * error if not) and how long it took. Errors still reach the caller; sync tools stay sync.
- * Outside a governed run it just calls the function.
- */
+// ── Guards ────────────────────────────────────────────────────────────────────
+function block(run, name, reason, breach = null) {
+    if (run.control.stopped)
+        run.control.stopSeen = true; // the agent learns of the stop here, so don't cancel it
+    throw new ToolBlocked(name, reason, breach);
+}
+const fits = (run, amount) => run.budgetUsd === null || Math.round((run.costUsd + run.reservedUsd + amount) * 1e9) / 1e9 <= run.budgetUsd;
+async function approve(run, name, summary, amount) {
+    const answer = await control.requestApproval(`${name}(${summary})`, { amountUsd: amount || undefined });
+    if (!answer.granted)
+        block(run, name, answer.note ? `not approved: ${answer.note}` : "not approved");
+    return answer.approvalId;
+}
+/** Check a guarded call and reserve its amount; returns the guard id, or throws ToolBlocked. */
+async function open(run, name, summary, amount, needsApproval) {
+    if (run.control.quarantined)
+        block(run, name, "the agent is quarantined in Fences"); // now, not when the quarantine's pause ends
+    if (run.control.paused)
+        await control.waitIfPaused(run);
+    if (run.control.pauseExpired)
+        block(run, name, "the run was paused from the Fences dashboard and not resumed in time", "paused");
+    let approvalId = needsApproval ? await approve(run, name, summary, amount) : null;
+    if (run.control.stopped)
+        block(run, name, "the run was stopped from the Fences dashboard", "stopped_by_user");
+    const client = _client();
+    if (!client) { // local mode: the same rules, applied here
+        const breach = run.lastBreach ?? localBreach(run);
+        if (breach)
+            block(run, name, `the run is over a limit (${breach})`, breach);
+        if (!fits(run, amount))
+            block(run, name, `$${amount.toFixed(2)} more would take the run past its $${run.budgetUsd.toFixed(2)} budget`, "budget_exceeded");
+        run.reservedUsd += amount;
+        return randomUUID();
+    }
+    // Check against what this process already holds before asking the server, which can't see it; reserve until it answers
+    if (!fits(run, amount))
+        block(run, name, `$${amount.toFixed(2)} more could take the run past its $${run.budgetUsd.toFixed(2)} budget`, "budget_exceeded");
+    run.reservedUsd += amount;
+    try {
+        const sent = events.redact({ type: "guard", tool: name, arguments: summary }) ?? {}; // the check goes ahead without them
+        let resp = {}; // eslint-disable-line @typescript-eslint/no-explicit-any
+        for (let attempt = 0; attempt < 2; attempt++) { // once more after an approval the server asked for
+            const guardId = randomUUID();
+            resp = await client.guard(run.runId, { guard_id: guardId, phase: "check", tool: name, arguments: sent.arguments ?? null,
+                amount_usd: amount, approval_id: approvalId });
+            control.apply(run, resp.commands);
+            if (resp.allow === true)
+                return guardId;
+            if (!(resp.needs_approval && approvalId === null))
+                break;
+            approvalId = await approve(run, name, summary, amount);
+        }
+        if (resp.unsupported) {
+            control.unsupported("guard", "guarded tools", "they are blocked");
+            block(run, name, "this Fences server doesn't support guarded tools");
+        }
+        if (resp.network_error || !("allow" in resp))
+            block(run, name, "couldn't reach Fences to check this call"); // no answer: fail closed
+        block(run, name, resp.reason ?? "not allowed", resp.breach ?? null);
+    }
+    catch (e) {
+        run.reservedUsd -= amount;
+        throw e;
+    }
+}
+/** Release the reservation and charge the run: in full unless the tool threw (a timeout may have done it). */
+async function settle(run, guardId, amount, error, failed) {
+    const outcome = !failed ? "ok" : error?.name === "TimeoutError" ? "unknown" : "error";
+    const charged = outcome === "error" ? 0 : amount;
+    run.reservedUsd -= amount;
+    run.costUsd += charged;
+    await _client()?.guard(run.runId, { guard_id: guardId, phase: "settle", outcome, cost_usd: charged });
+}
+function timed(p, timeoutS, name) {
+    if (timeoutS === undefined)
+        return p;
+    let timer;
+    const late = new Promise((_, reject) => {
+        timer = setTimeout(() => reject(new DOMException(`${name} took longer than ${timeoutS}s`, "TimeoutError")), timeoutS * 1000);
+    });
+    return Promise.race([p, late]).finally(() => clearTimeout(timer));
+}
 export function tool(fn, options = {}) {
     const name = options.name ?? (fn.name || "tool");
+    const guarded = !!options.guard || options.costUsd !== undefined || !!options.approve;
+    if (guarded || options.timeoutS !== undefined) {
+        return async (...args) => {
+            const run = getActiveRun();
+            if (!run)
+                return timed(Promise.resolve().then(() => fn(...args)), options.timeoutS, name);
+            const summary = argsSummary(args), started = performance.now();
+            let gate = null;
+            try {
+                if (guarded) {
+                    const c = options.costUsd, amount = Number((typeof c === "function" ? c(...args) : c) ?? 0);
+                    gate = [await open(run, name, summary, amount, !!options.approve), amount];
+                }
+                const out = await timed(Promise.resolve().then(() => fn(...args)), options.timeoutS, name);
+                recordToolCall(name, summary, started);
+                if (gate)
+                    await settle(run, ...gate, undefined, false);
+                return out;
+            }
+            catch (e) {
+                recordToolCall(name, summary, started, e);
+                if (gate)
+                    await settle(run, ...gate, e, true);
+                throw e;
+            }
+        };
+    }
     return (...args) => {
         if (!getActiveRun())
             return fn(...args);

package/dist/version.d.ts

@@ -1,2 +1,2 @@
 /** The one place the version lives; sent to Fences on every request. Keep in step with package.json. */
-export declare const VERSION = "0.3.0";
+export declare const VERSION = "0.5.0";

package/dist/version.js

@@ -1,2 +1,2 @@
 /** The one place the version lives; sent to Fences on every request. Keep in step with package.json. */
-export const VERSION = "0.3.0";
+export const VERSION = "0.5.0";

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "agentfences",
-  "version": "0.3.0",
+  "version": "0.5.0",
   "description": "On-call for AI agents: limits your agents can't raise, cost tracking, a decision trail, and a stop button",
   "license": "MIT",
   "author": "Bhavik Sardar",