ambitry 0.1.2 → 0.1.3

package/README.md

@@ -150,6 +150,8 @@ Point a provider at a different upstream — Azure, a gateway, a local model —
 
 Cost is computed from published per-token rates. Models with no known rate report `null` rather than a guess; a cost dashboard that quietly invents numbers is worse than one that admits ignorance.
 
+**One request modification, and the only one.** OpenAI-compatible providers omit token usage from streamed responses unless `stream_options.include_usage` is set, and almost no agent code sets it — so without this, cost and spend caps would be blank for most streaming traffic. Ambitry adds that flag to outgoing OpenAI streaming requests when you haven't set it yourself. The visible effect is one extra terminal chunk carrying usage, which SDKs treat as a normal chunk with no choices. If you set `stream_options` yourself, it's left alone, and Anthropic requests are never modified.
+
 ## Development
 
 ```bash

package/dist/server.js

@@ -33,9 +33,22 @@ export function createServer({ store, controls }) {
                 examples: ['http://localhost:8787/anthropic', 'http://localhost:8787/openai/v1'],
             });
         }
-        const body = await readBody(req);
+        let body = await readBody(req);
         const parsed = parseRequest(route.provider.id, body);
         const requestJson = safeJson(body);
+        // OpenAI-compatible providers omit usage from streamed responses unless
+        // stream_options.include_usage is set, and almost no agent code sets it.
+        // Without this the cost column is empty for most streaming traffic, which
+        // guts the spend caps. Anthropic always reports usage, so this is only
+        // needed here. The cost is one extra terminal chunk carrying usage, which
+        // SDKs treat as a normal chunk with no choices.
+        if (route.provider.id === 'openai' && parsed.stream && requestJson && typeof requestJson === 'object') {
+            const r = requestJson;
+            if (r.stream_options === undefined) {
+                r.stream_options = { include_usage: true };
+                body = Buffer.from(JSON.stringify(r));
+            }
+        }
         // Scanned on the way out, so a leak is caught on the request that carries
         // it rather than after the provider has already received it.
         const findings = scanRequest(requestJson);

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "ambitry",
-  "version": "0.1.2",
+  "version": "0.1.3",
   "description": "Audit log and permission layer for AI agents. One-line integration, zero runtime dependencies.",
   "type": "module",
   "bin": {