@opencode-ai/ai 0.0.0-beta-17639 → 0.0.0-beta-17728

package/README.md

@@ -237,11 +237,11 @@ Prompt caching is **on by default**. Every `LLMRequest` resolves to `cache: "aut
 
 ### Auto placement
 
-`"auto"` places up to four breakpoints — the last tool definition, the first system part, the last system part when distinct, and the final message boundary. These expose successively larger reusable prefixes for tools, the base agent, project instructions, and the active conversation. The rolling final-message boundary is the load-bearing detail in tool loops: it advances on every request so the previous cache entry stays within Anthropic's 20-block lookback.
+`"auto"` places up to four breakpoints — the last tool definition, the first system part, the last system part when distinct, and the final message boundary. These expose successively larger reusable prefixes for tools, the base agent, project instructions, and the active conversation. The rolling final-message boundary advances on every request so recent conversation prefixes remain reusable during tool loops.
 
 Tools precede every system and conversation block in the provider prefix, so tool definitions must remain byte-stable and deterministically ordered for downstream breakpoints to remain reusable.
 
-The math justifies the default: Anthropic's 5-minute cache write is 1.25× base, read is 0.1×, so a single reuse within 5 minutes already wins. One-shot completions below the per-model minimum-cacheable-token threshold silently no-op on the wire, so the worst case is harmless.
+Requests below a provider's minimum cacheable size simply do not produce a reusable cache entry.
 
 ### Opting out
 
@@ -285,6 +285,7 @@ LLM.request({
 | ----------------------- | ------------------------------------------------------------------------- |
 | Anthropic Messages      | emits up to 4 `cache_control` markers (4-breakpoint cap enforced)         |
 | Bedrock Converse        | emits up to 4 `cachePoint` blocks (4-breakpoint cap enforced)             |
+| OpenRouter              | emits up to 4 `cache_control` markers                                     |
 | OpenAI Chat / Responses | no-op (implicit caching above 1024 tokens)                                |
 | Gemini                  | no-op (implicit caching on 2.5+; explicit `CachedContent` is out-of-band) |
 
@@ -308,7 +309,7 @@ Included providers: OpenAI, Anthropic, Google (Gemini), Google Vertex Gemini and
 
 ### Package-like entrypoints
 
-Native catalog integrations load provider behavior through package-like entrypoints. These are export paths from the same `@opencode-ai/ai` npm package, not independently published packages. Each entrypoint exports the same `model(modelID, settings)` contract, and `settings` contains serializable provider configuration plus common `headers`, `body`, and `limits` overlays.
+Native catalog integrations load provider behavior through package-like entrypoints. These are export paths from the same `@opencode-ai/ai` npm package, not independently published packages. Each entrypoint exports the same `model(modelID, settings)` contract, and `settings` contains serializable provider configuration plus common `headers` and `body` overlays.
 
 ```ts
 import { model } from "@opencode-ai/ai/providers/openai/responses"
@@ -316,7 +317,6 @@ import { model } from "@opencode-ai/ai/providers/openai/responses"
 const selected = model("gpt-5", {
   apiKey: process.env.OPENAI_API_KEY,
   headers: { "x-application": "opencode" },
-  limits: { context: 200_000, output: 64_000 },
 })
 ```
 
@@ -371,11 +371,23 @@ Request options in order of stability:
 
 1. **`generation`** — portable knobs (`maxTokens`, `temperature`, `topP`, `topK`, penalties, seed, stop).
 2. **`promptCacheKey`** — stable cache affinity lowered by every protocol that supports it.
-3. **`providerOptions: { <provider>: {...} }`** — typed-at-the-facade provider-specific knobs (OpenAI `store`, Anthropic `thinking`, Gemini `thinkingConfig`, OpenRouter routing).
+3. **`providerOptions: { ... }`** — flat options inferred from the selected model (OpenAI `store`, Anthropic `thinking`, Gemini `thinkingConfig`, OpenRouter routing).
 4. **`http: { body, headers, query }`** — last-resort serializable overlays merged into the final HTTP request. Reach for this only when a stable typed path doesn't yet exist.
 
 Route/provider defaults are overridden by request-level values for each axis.
 
+The selected model supplies the provider-specific option type, so per-request overrides stay flat while the canonical runtime request remains provider-neutral:
+
+```ts
+LLM.request({
+  model,
+  prompt,
+  providerOptions: {
+    reasoningEffort: "low",
+  },
+})
+```
+
 ## Routes
 
 Adding a new model or deployment is usually 5-15 lines using `Route.make({ protocol, endpoint, auth, framing, ... })`. The route owns endpoint/auth/framing and the protocol owns body construction plus stream parsing. Transports are reusable IO templates that receive route endpoint/auth at compile time. Capability/catalog metadata lives outside this low-level package; unsupported request shapes fail during protocol lowering. See `AGENTS.md` for the architectural detail.
@@ -387,6 +399,5 @@ This package is built on Effect. Public methods return `Effect` or `Stream`; pro
 ## See also
 
 - `AGENTS.md` — architecture, route construction, contributor guide
-- `STATUS.md` — native provider parity status and AI SDK migration gaps
 - `example/tutorial.ts` — runnable end-to-end walkthrough
 - `test/provider/*.test.ts` — fixture-first protocol tests; `*.recorded.test.ts` files cover live cassettes

package/dist/cache-policy.js

@@ -5,8 +5,8 @@
 // The default `"auto"` shape places breakpoints at the last tool definition,
 // the first and last distinct system parts, and the conversation tail. This
 // exposes reusable tool, base-agent, project, and session prefixes while
-// advancing the tail after each tool result keeps the previous cache entry
-// within Anthropic's 20-block lookback during long agent turns.
+// advancing the tail after each tool result keeps recent conversation prefixes
+// reusable during long agent runs.
 //
 // Manual `cache: CacheHint` placements on individual parts are preserved and
 // count against the four-breakpoint budget; auto only fills remaining slots.
@@ -20,9 +20,7 @@ const AUTO = {
 const NONE = {};
 const BREAKPOINT_CAP = 4;
 // Resolution rules:
-//   - undefined   → "auto" — caching is on by default. The math favors it:
-//                   Anthropic 5m-cache write is 1.25x base, read is 0.1x,
-//                   so a single reuse within 5 minutes already wins.
+//   - undefined   → "auto" — caching is on by default.
 //   - "auto"      → tools + first/last system + final message boundary.
 //   - "none"      → no auto placement; manual `CacheHint`s still flow.
 //   - object form → exactly what the caller asked for.

package/dist/protocols/anthropic-messages.d.ts

@@ -1,11 +1,11 @@
 import { Schema } from "effect";
 import { Route } from "../route/client.js";
 import { Protocol } from "../route/protocol.js";
-import { type ProviderOptions } from "../schema/index.js";
 import { Lifecycle } from "./utils/lifecycle.js";
 import { ToolStream } from "./utils/tool-stream.js";
 export declare const DEFAULT_BASE_URL = "https://api.anthropic.com/v1";
 export declare const PATH = "/messages";
+export declare const DEFAULT_MAX_TOKENS = 32000;
 export type ThinkingInput = {
     readonly type: "adaptive";
     readonly display?: "summarized" | "omitted";
@@ -25,9 +25,7 @@ export interface OptionsInput {
     readonly thinking?: ThinkingInput;
     readonly effort?: string;
 }
-export type ProviderOptionsInput = ProviderOptions & {
-    readonly anthropic?: OptionsInput;
-};
+export type ProviderOptionsInput = OptionsInput;
 export declare const AnthropicMessagesBody: Schema.Struct<{
     model: Schema.String;
     system: Schema.optional<Schema.$Array<Schema.Struct<{
@@ -207,8 +205,8 @@ export declare const AnthropicMessagesBody: Schema.Struct<{
 export type AnthropicMessagesBody = Schema.Schema.Type<typeof AnthropicMessagesBody>;
 /**
  * The Anthropic Messages protocol — request body construction, body schema,
- * and the streaming-event state machine. Used by native Anthropic Cloud and
- * (once registered) Vertex Anthropic / Bedrock-hosted Anthropic passthrough.
+ * and the streaming-event state machine shared by Anthropic-compatible and
+ * Vertex-hosted Messages routes.
  */
 export declare const protocol: Protocol<{
     readonly max_tokens: number;
@@ -346,14 +344,6 @@ export declare const protocol: Protocol<{
         }[];
     })[];
     readonly stream: true;
-    readonly system?: readonly {
-        readonly type: "text";
-        readonly text: string;
-        readonly cache_control?: {
-            readonly type: "ephemeral";
-            readonly ttl?: "1h" | "5m" | undefined;
-        } | undefined;
-    }[] | undefined;
     readonly tools?: readonly {
         readonly description: string;
         readonly name: string;
@@ -365,6 +355,14 @@ export declare const protocol: Protocol<{
             readonly ttl?: "1h" | "5m" | undefined;
         } | undefined;
     }[] | undefined;
+    readonly system?: readonly {
+        readonly type: "text";
+        readonly text: string;
+        readonly cache_control?: {
+            readonly type: "ephemeral";
+            readonly ttl?: "1h" | "5m" | undefined;
+        } | undefined;
+    }[] | undefined;
     readonly temperature?: number | undefined;
     readonly thinking?: {
         readonly type: "enabled";
@@ -376,7 +374,7 @@ export declare const protocol: Protocol<{
         readonly type: "disabled";
     } | undefined;
     readonly tool_choice?: {
-        readonly type: "none" | "auto" | "any";
+        readonly type: "auto" | "none" | "any";
     } | {
         readonly type: "tool";
         readonly name: string;
@@ -389,10 +387,6 @@ export declare const protocol: Protocol<{
     } | undefined;
 }, string, {
     readonly type: string;
-    readonly error?: {
-        readonly type?: string | undefined;
-        readonly message?: string | undefined;
-    } | undefined;
     readonly message?: {
         readonly usage?: {
             readonly [x: string]: unknown;
@@ -410,6 +404,10 @@ export declare const protocol: Protocol<{
             } | null | undefined;
         } | undefined;
     } | undefined;
+    readonly error?: {
+        readonly type?: string | undefined;
+        readonly message?: string | undefined;
+    } | undefined;
     readonly delta?: {
         readonly type?: string | undefined;
         readonly text?: string | undefined;
@@ -588,14 +586,6 @@ export declare const route: Route<{
         }[];
     })[];
     readonly stream: true;
-    readonly system?: readonly {
-        readonly type: "text";
-        readonly text: string;
-        readonly cache_control?: {
-            readonly type: "ephemeral";
-            readonly ttl?: "1h" | "5m" | undefined;
-        } | undefined;
-    }[] | undefined;
     readonly tools?: readonly {
         readonly description: string;
         readonly name: string;
@@ -607,6 +597,14 @@ export declare const route: Route<{
             readonly ttl?: "1h" | "5m" | undefined;
         } | undefined;
     }[] | undefined;
+    readonly system?: readonly {
+        readonly type: "text";
+        readonly text: string;
+        readonly cache_control?: {
+            readonly type: "ephemeral";
+            readonly ttl?: "1h" | "5m" | undefined;
+        } | undefined;
+    }[] | undefined;
     readonly temperature?: number | undefined;
     readonly thinking?: {
         readonly type: "enabled";
@@ -618,7 +616,7 @@ export declare const route: Route<{
         readonly type: "disabled";
     } | undefined;
     readonly tool_choice?: {
-        readonly type: "none" | "auto" | "any";
+        readonly type: "auto" | "none" | "any";
     } | {
         readonly type: "tool";
         readonly name: string;

package/dist/protocols/anthropic-messages.js

@@ -15,6 +15,7 @@ import { ToolStream } from "./utils/tool-stream.js";
 const ADAPTER = "anthropic-messages";
 export const DEFAULT_BASE_URL = "https://api.anthropic.com/v1";
 export const PATH = "/messages";
+export const DEFAULT_MAX_TOKENS = 32_000;
 // =============================================================================
 // Request Body Schema
 // =============================================================================
@@ -468,7 +469,7 @@ const lowerMessages = Effect.fn("AnthropicMessages.lowerMessages")(function* (re
     return messages;
 });
 const resolveOptions = Effect.fn("AnthropicMessages.resolveOptions")(function* (request) {
-    const input = request.providerOptions?.anthropic;
+    const input = request.providerOptions;
     return {
         thinking: yield* resolveThinking(input?.thinking),
         effort: typeof input?.effort === "string" ? input.effort : undefined,
@@ -501,7 +502,6 @@ const resolveThinking = Effect.fn("AnthropicMessages.resolveThinking")(function*
 const fromRequest = Effect.fn("AnthropicMessages.fromRequest")(function* (request) {
     const generation = request.generation;
     const toolSchemaCompatibility = request.model.compatibility?.toolSchema;
-    const outputLimit = request.model.defaults?.limits?.output ?? request.model.route.defaults.limits?.output ?? 4096;
     // Allocate the 4-breakpoint budget in invalidation order: tools → system →
     // messages. Tools live highest in the cache hierarchy, so when callers
     // over-mark we keep their tool hints and shed the message-tail ones first.
@@ -530,7 +530,7 @@ const fromRequest = Effect.fn("AnthropicMessages.fromRequest")(function* (reques
         tools,
         tool_choice: toolChoice,
         stream: true,
-        max_tokens: generation?.maxTokens ?? outputLimit,
+        max_tokens: generation?.maxTokens ?? DEFAULT_MAX_TOKENS,
         temperature: generation?.temperature,
         top_p: generation?.topP,
         top_k: generation?.topK,
@@ -844,8 +844,8 @@ const step = (state, event) => {
 // =============================================================================
 /**
  * The Anthropic Messages protocol — request body construction, body schema,
- * and the streaming-event state machine. Used by native Anthropic Cloud and
- * (once registered) Vertex Anthropic / Bedrock-hosted Anthropic passthrough.
+ * and the streaming-event state machine shared by Anthropic-compatible and
+ * Vertex-hosted Messages routes.
  */
 export const protocol = Protocol.make({
     id: ADAPTER,

package/dist/protocols/gemini.d.ts

@@ -1,7 +1,6 @@
 import { Schema } from "effect";
 import { Route } from "../route/client.js";
 import { Protocol } from "../route/protocol.js";
-import { type ProviderOptions } from "../schema/index.js";
 import { Lifecycle } from "./utils/lifecycle.js";
 export declare const DEFAULT_BASE_URL = "https://generativelanguage.googleapis.com/v1beta";
 export interface OptionsInput {
@@ -18,9 +17,7 @@ export interface OptionsInput {
         readonly thinkingLevel?: "minimal" | "low" | "medium" | "high" | (string & {});
     };
 }
-export type ProviderOptionsInput = ProviderOptions & {
-    readonly gemini?: OptionsInput;
-};
+export type ProviderOptionsInput = OptionsInput;
 declare const GeminiBody: Schema.Struct<{
     cachedContent: Schema.optional<Schema.String>;
     contents: Schema.$Array<Schema.Struct<{
@@ -98,12 +95,11 @@ declare const GeminiBody: Schema.Struct<{
 export type GeminiBody = Schema.Schema.Type<typeof GeminiBody>;
 /**
  * The Gemini protocol — request body construction, body schema, and the
- * streaming-event state machine. Used by Google AI Studio Gemini and (once
- * registered) Vertex Gemini.
+ * streaming-event state machine shared by Google AI Studio and Vertex Gemini.
  */
 export declare const protocol: Protocol<{
     readonly contents: readonly {
-        readonly role: "user" | "model";
+        readonly role: "model" | "user";
         readonly parts: readonly ({
             readonly inlineData: {
                 readonly mimeType: string;
@@ -181,7 +177,7 @@ export declare const protocol: Protocol<{
 }, string, {
     readonly candidates?: readonly {
         readonly content?: {
-            readonly role: "user" | "model";
+            readonly role: "model" | "user";
             readonly parts: readonly ({
                 readonly inlineData: {
                     readonly mimeType: string;
@@ -234,7 +230,7 @@ export declare const protocol: Protocol<{
 }>;
 export declare const route: Route<{
     readonly contents: readonly {
-        readonly role: "user" | "model";
+        readonly role: "model" | "user";
         readonly parts: readonly ({
             readonly inlineData: {
                 readonly mimeType: string;

package/dist/protocols/gemini.js

@@ -201,7 +201,9 @@ const lowerMessages = Effect.fn("Gemini.lowerMessages")(function* (request) {
         if (message.role === "system") {
             const part = yield* ProviderShared.wrappedSystemUpdate("Gemini", message);
             const previous = contents.at(-1);
-            if (previous?.role === "user")
+            // Gemini rejects a continuation whose function-response turn carries extra
+            // parts, so an update after a tool result starts its own user turn.
+            if (previous?.role === "user" && !previous.parts.some((item) => "functionResponse" in item))
                 contents[contents.length - 1] = { role: "user", parts: [...previous.parts, { text: part.text }] };
             else
                 contents.push({ role: "user", parts: [{ text: part.text }] });
@@ -293,7 +295,7 @@ const lowerMessages = Effect.fn("Gemini.lowerMessages")(function* (request) {
     return contents;
 });
 const resolveOptions = (request) => {
-    const input = request.providerOptions?.gemini;
+    const input = request.providerOptions;
     const value = input?.thinkingConfig;
     const thinkingConfig = {
         thinkingBudget: ProviderShared.isRecord(value) && typeof value.thinkingBudget === "number" ? value.thinkingBudget : undefined,
@@ -491,8 +493,7 @@ const step = (state, event) => {
 // =============================================================================
 /**
  * The Gemini protocol — request body construction, body schema, and the
- * streaming-event state machine. Used by Google AI Studio Gemini and (once
- * registered) Vertex Gemini.
+ * streaming-event state machine shared by Google AI Studio and Vertex Gemini.
  */
 export const protocol = Protocol.make({
     id: ADAPTER,