@bastani/pi-ai 0.9.26-alpha.2 → 0.9.26-alpha.3

package/CHANGELOG.md

@@ -4,6 +4,24 @@ This package is a Bastani fork of `@earendil-works/pi-ai`. Upstream history at t
 
 ## [Unreleased]
 
+## [0.9.26-alpha.3] - 2026-10-03
+
+### Added
+
+- Added Cloudflare's Clef and Clef Flash classifier models (`@cf/cloudflare/clef`, `@cf/cloudflare/clef-flash`) to the `cloudflare-workers-ai` provider ([#10316](https://github.com/earendil-works/pi/pull/10316) by [@ndisidore](https://github.com/ndisidore), [#10322](https://github.com/earendil-works/pi/pull/10322) by [@RealAlexandreAI](https://github.com/RealAlexandreAI)).
+
+### Changed
+
+- Native Anthropic tool changes now define added and redefined tools inline, keeping the initial tool list stable for prompt caching. `hasToolRedefinitions()` is deprecated.
+
+### Fixed
+
+- Provider errors containing "Selected model is at capacity" are now retried.
+- Cloudflare AI Gateway now uses dashed Claude model IDs accepted by its Anthropic endpoint.
+- Fixed Sign in with ChatGPT continuing when its callback port is taken by another login, which made the browser show "OAuth state mismatch"; it now fails with a port-in-use error before opening the browser ([#10265](https://github.com/earendil-works/pi/issues/10265)).
+- Amazon Bedrock OpenAI models are no longer costed at the short-context rate above 272k input tokens; Bedrock models now include the pricing tiers listed on models.dev ([#10326](https://github.com/earendil-works/pi/issues/10326)).
+- Amazon Bedrock Claude requests no longer fail with "Invalid `signature` in `thinking` block" after the system prompt or tools change; Claude Opus 4.7+, Sonnet 5+, and Fable 5 now drop stale thinking blocks like the Anthropic provider ([#10324](https://github.com/earendil-works/pi/issues/10324)).
+
 ## [0.9.26-alpha.2] - 2026-10-02
 
 ### Added

package/NOTICE.md

@@ -6,7 +6,7 @@ monorepo at `packages/ai` and publishes at the same version as `@bastani/atomic`
 
 - Upstream package: [`@earendil-works/pi-ai`](https://www.npmjs.com/package/@earendil-works/pi-ai)
 - Original fork point: `v0.84.2` (`914cf1472e715297caa30db4b9535d534a9eb718`)
-- Applicable Pi AI fixes synced through audited upstream `main`: `earendil-works/pi@86dfceec402ad77e563bf4feab5f26c42d5f5db6`, with remaining registry Pi packages at `1.0.0`. Atomic retains its adaptations and does not enable upstream virtual models.
+- Applicable Pi AI fixes synced through audited upstream `main`: `earendil-works/pi@c10bfb0d79dbbc998539a0a3e6c6a736a4e6db06`, with remaining registry Pi packages at `1.0.0`. Atomic retains its adaptations and does not enable upstream virtual models.
 - Catalog JSON under `src/providers/data/` is generated at build time from models.dev, matching upstream. It is not committed.
 
 Original work is Copyright (c) 2025 Mario Zechner and is licensed under the MIT License.

package/README.md

@@ -879,7 +879,7 @@ Classifier models consume structured JSON state and answer one or more typed que
 | --- | --- | --- |
 | `typesafe` | `jev-latest` | `TYPESAFE_API_KEY` |
 | `openrouter` | `typesafe/jev-1.13`, `~typesafe/jev-latest` | `OPENROUTER_API_KEY` or OpenRouter OAuth |
-| `cloudflare-workers-ai` | `typesafe/jev` | `CLOUDFLARE_API_KEY` and `CLOUDFLARE_ACCOUNT_ID` |
+| `cloudflare-workers-ai` | `typesafe/jev`, `@cf/cloudflare/clef`, `@cf/cloudflare/clef-flash` | `CLOUDFLARE_API_KEY` and `CLOUDFLARE_ACCOUNT_ID` |
 | `vercel-ai-gateway` | `typesafe-ai/jev` | `AI_GATEWAY_API_KEY` |
 | `opencode` | `jev-1.13`, `jev-1.13-free` | `OPENCODE_API_KEY` |
 
@@ -1561,6 +1561,8 @@ Later system messages append instructions, patch named sections (`null` removes
 
 Models with `supportsMidConvoSystemMessages` receive updates in place. Other models receive the replayed prompt and tools as a leading checkpoint. Anthropic's `supportsMidConvoToolChanges`, OpenAI Responses' `supportsAdditionalTools`/`supportsToolSearch`, and OpenAI Completions' `supportsMidConvoToolAdditions` enable native tool transitions where representable. Unsupported transitions fall back to the current top-level tool list and may invalidate the cached prefix.
 
+With Anthropic's `supportsMidConvoToolChanges`, the `inline-tools-2026-09-15` beta keeps the initial top-level tools and a deferred placeholder fixed. Later `tool_addition` blocks carry complete definitions, including replacements under an existing name; `tool_removal` blocks reference names. This preserves the cached prefix across tool changes. At least one initial tool is required; otherwise the current tool list is sent at the top level.
+
 ## Context Serialization
 
 The `Context` object can be easily serialized and deserialized using standard JSON methods, making it simple to persist conversations, implement chat history, or transfer contexts between services:

package/dist/api/anthropic-messages.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"anthropic-messages.d.ts","sourceRoot":"","sources":["../../src/api/anthropic-messages.ts"],"names":[],"mappings":"AAAA,OAAO,SAAiC,MAAM,mBAAmB,CAAC;AAiBlE,OAAO,KAAK,EASX,mBAAmB,EAEnB,cAAc,EACd,aAAa,EAOb,MAAM,aAAa,CAAC;AAsKrB,MAAM,MAAM,eAAe,GAAG,KAAK,GAAG,QAAQ,GAAG,MAAM,GAAG,OAAO,GAAG,KAAK,CAAC;AAE1E,MAAM,MAAM,wBAAwB,GAAG,YAAY,GAAG,SAAS,CAAC;AAoPhE,MAAM,WAAW,gBAAiB,SAAQ,aAAa;IACtD;;;;;;OAMG;IACH,eAAe,CAAC,EAAE,OAAO,CAAC;IAC1B;;;;OAIG;IACH,oBAAoB,CAAC,EAAE,MAAM,CAAC;IAC9B;;;;;;;;;;;OAWG;IACH,MAAM,CAAC,EAAE,eAAe,CAAC;IACzB;;;;;;;;;;;OAWG;IACH,eAAe,CAAC,EAAE,wBAAwB,CAAC;IAC3C;;;;;OAKG;IACH,mBAAmB,CAAC,EAAE,OAAO,CAAC;IAC9B;;;;OAIG;IACH,UAAU,CAAC,EAAE,MAAM,GAAG,KAAK,GAAG,MAAM,GAAG;QAAE,IAAI,EAAE,MAAM,CAAC;QAAC,IAAI,EAAE,MAAM,CAAA;KAAE,CAAC;IACtE;;;;OAIG;IACH,MAAM,CAAC,EAAE,SAAS,CAAC;CACnB;AAgSD,eAAO,MAAM,MAAM,EAAE,cAAc,CAAC,oBAAoB,EAAE,gBAAgB,CA6XzE,CAAC;AA4BF,eAAO,MAAM,YAAY,EAAE,cAAc,CAAC,oBAAoB,EAAE,mBAAmB,CAgDlF,CAAC"}
+{"version":3,"file":"anthropic-messages.d.ts","sourceRoot":"","sources":["../../src/api/anthropic-messages.ts"],"names":[],"mappings":"AAAA,OAAO,SAAiC,MAAM,mBAAmB,CAAC;AAiBlE,OAAO,KAAK,EASX,mBAAmB,EAEnB,cAAc,EACd,aAAa,EAOb,MAAM,aAAa,CAAC;AAoKrB,MAAM,MAAM,eAAe,GAAG,KAAK,GAAG,QAAQ,GAAG,MAAM,GAAG,OAAO,GAAG,KAAK,CAAC;AAE1E,MAAM,MAAM,wBAAwB,GAAG,YAAY,GAAG,SAAS,CAAC;AAmPhE,MAAM,WAAW,gBAAiB,SAAQ,aAAa;IACtD;;;;;;OAMG;IACH,eAAe,CAAC,EAAE,OAAO,CAAC;IAC1B;;;;OAIG;IACH,oBAAoB,CAAC,EAAE,MAAM,CAAC;IAC9B;;;;;;;;;;;OAWG;IACH,MAAM,CAAC,EAAE,eAAe,CAAC;IACzB;;;;;;;;;;;OAWG;IACH,eAAe,CAAC,EAAE,wBAAwB,CAAC;IAC3C;;;;;OAKG;IACH,mBAAmB,CAAC,EAAE,OAAO,CAAC;IAC9B;;;;OAIG;IACH,UAAU,CAAC,EAAE,MAAM,GAAG,KAAK,GAAG,MAAM,GAAG;QAAE,IAAI,EAAE,MAAM,CAAC;QAAC,IAAI,EAAE,MAAM,CAAA;KAAE,CAAC;IACtE;;;;OAIG;IACH,MAAM,CAAC,EAAE,SAAS,CAAC;CACnB;AAgSD,eAAO,MAAM,MAAM,EAAE,cAAc,CAAC,oBAAoB,EAAE,gBAAgB,CA4XzE,CAAC;AA4BF,eAAO,MAAM,YAAY,EAAE,cAAc,CAAC,oBAAoB,EAAE,mBAAmB,CAgDlF,CAAC"}

package/dist/api/anthropic-messages.js

@@ -12,7 +12,7 @@ import { retryProviderRequest } from "../utils/provider-retry.js";
 import { sanitizeSurrogates } from "../utils/sanitize-unicode.js";
 import { createStreamDeadline, withStreamDeadline } from "../utils/stream-deadline.js";
 import { getSystemMessageText, renderSystemMessageUpdate } from "../utils/text.js";
-import { getCurrentTools, getDeclaredTools, getInitialSystemMessage, hasToolRedefinitions, resolveTranscript, } from "../utils/transcript.js";
+import { getCurrentTools, getInitialSystemMessage, resolveTranscript, } from "../utils/transcript.js";
 import { ANTHROPIC_STRICT_JSON_SCHEMA_PROFILE, getJsonSchemaToolParameters, resolveJsonSchemaStrictSampling, } from "./constrained-sampling.js";
 import { buildCopilotDynamicHeaders, hasCopilotVisionInput, preserveCopilotIntegrationHeader, } from "./github-copilot-headers.js";
 import { adjustMaxTokensForThinking, buildBaseOptions, clampMaxTokensToContext } from "./simple-options.js";
@@ -129,7 +129,7 @@ const INTERLEAVED_THINKING_BETA = "interleaved-thinking-2025-05-14";
 const SERVER_SIDE_FALLBACK_BETA = "server-side-fallback-2026-07-01";
 const THINKING_BINDING_CONTROLS_BETA = "thinking-binding-controls-2026-08-01";
 const MID_CONVERSATION_OUTPUT_CONFIG_BETA = "mid-conversation-output-config-2026-07-01";
-const MID_CONVERSATION_TOOL_CHANGES_BETA = "mid-conversation-tool-changes-2026-07-01";
+const INLINE_TOOLS_BETA = "inline-tools-2026-09-15";
 const FAST_MODE_BETA = "fast-mode-2026-02-01";
 /**
  * Fast mode bills every token category at twice the standard rate for each supported model, across
@@ -187,10 +187,9 @@ function assertPayloadPreservesFastRoute(model, payload) {
 }
 /**
  * Stable deferred tool declared whenever native tool changes are in use. Anthropic adds
- * hidden prompt scaffolding as soon as any tool has `defer_loading`; declaring this
- * placeholder from the first request keeps that scaffolding in the cached prefix, so the
- * first real late tool does not invalidate the cache (measured: full miss without it).
- * It is never activated and the model cannot see it.
+ * hidden prompt scaffolding for mid-conversation tool changes; declaring this placeholder
+ * from the first request keeps that scaffolding in the cached prefix. It is never activated
+ * and the model cannot see it.
  */
 const DEFERRED_TOOL_PLACEHOLDER = {
     name: "__pi_deferred_placeholder__",
@@ -606,8 +605,7 @@ export const stream = (model, context, options) => {
                 const cacheSessionId = cacheRetention === "none" ? undefined : options?.sessionId;
                 const created = createClient(model, apiKey, model.reasoning && options?.thinkingEnabled === true && (options.interleavedThinking ?? true), shouldUseFineGrainedToolStreamingBeta(model, context), shouldUseServerSideFallbackBeta(model), options?.headers, options?.fetch, copilotDynamicHeaders, cacheSessionId, getAnthropicCompat(model).supportsMidConvoToolChanges &&
                     getAnthropicCompat(model).supportsMidConvoSystemMessages &&
-                    (getInitialSystemMessage(normalizedContext.messages)?.toolsAdded?.length ?? 0) > 0 &&
-                    !hasToolRedefinitions(normalizedContext.messages), federation);
+                    (getInitialSystemMessage(normalizedContext.messages)?.toolsAdded?.length ?? 0) > 0, federation);
                 client = created.client;
                 isOAuth = created.isOAuthToken;
             }
@@ -983,7 +981,7 @@ function createClient(model, apiKey, interleavedThinking, useFineGrainedToolStre
         betaFeatures.push(MID_CONVERSATION_OUTPUT_CONFIG_BETA, THINKING_BINDING_CONTROLS_BETA);
     }
     if (useNativeToolChanges)
-        betaFeatures.push(MID_CONVERSATION_TOOL_CHANGES_BETA);
+        betaFeatures.push(INLINE_TOOLS_BETA);
     if (requestedSpeed(model) === "fast")
         betaFeatures.push(FAST_MODE_BETA);
     const uniqueBetaFeatures = [...new Set(betaFeatures)];
@@ -1075,7 +1073,7 @@ function getNativeToolChangeBetas(model, context, isOAuth, options) {
                 .map((feature) => feature.trim())
                 .filter(Boolean)),
         ];
-    const features = [MID_CONVERSATION_TOOL_CHANGES_BETA];
+    const features = [INLINE_TOOLS_BETA];
     if (isOAuth)
         features.push("claude-code-20250219", "oauth-2025-04-20");
     if (shouldUseFineGrainedToolStreamingBeta(model, context))
@@ -1103,15 +1101,11 @@ function buildParams(model, context, isOAuthToken, options) {
     const initialSystemText = initialSystemMessage ? getSystemMessageText(initialSystemMessage) : "";
     const transformedMessages = transformMessages(context.messages, model, normalizeToolCallId);
     const conversationMessages = initialSystemMessage ? transformedMessages.slice(1) : transformedMessages;
-    // Native tool changes reference tools by name, so a redefined name cannot be expressed,
-    // and Anthropic rejects a tool list where every tool is deferred, so there must be an
-    // initial active tool to anchor the deferred ones. Otherwise the current tool list is sent.
     const initialTools = initialSystemMessage?.toolsAdded ?? [];
-    const nativeToolChanges = compat.supportsMidConvoSystemMessages &&
-        compat.supportsMidConvoToolChanges &&
-        initialTools.length > 0 &&
-        !hasToolRedefinitions(context.messages);
-    const converted = convertMessages(conversationMessages, isOAuthToken, cacheControl, compat.allowEmptySignature, supportsMidConvoEffort(model) ? model.provider : undefined, nativeToolChanges);
+    const nativeToolChanges = compat.supportsMidConvoSystemMessages && compat.supportsMidConvoToolChanges && initialTools.length > 0;
+    const converted = convertMessages(conversationMessages, isOAuthToken, cacheControl, compat.allowEmptySignature, supportsMidConvoEffort(model) ? model.provider : undefined, nativeToolChanges
+        ? (tools) => convertTools(tools, isOAuthToken, compat.supportsEagerToolInputStreaming, compat.supportsStrictTools)
+        : undefined);
     const activeEffort = options?.effort ?? "high";
     const params = {
         model: upstreamModelId(model),
@@ -1162,16 +1156,9 @@ function buildParams(model, context, isOAuthToken, options) {
     }
     const toolCacheControl = compat.supportsCacheControlOnTools ? cacheControl : undefined;
     if (nativeToolChanges) {
-        // Initial tools stay active with the cache breakpoint on the last one. Every later
-        // declaration is deferred and only surfaced by its `tool_addition` block; removed
-        // tools stay declared and are withdrawn by `tool_removal`. The request-level list
-        // therefore only grows, keeping the cached prefix intact across tool changes.
-        const initialNames = new Set(initialTools.map((tool) => tool.name));
-        const laterTools = getDeclaredTools(context.messages).filter((tool) => !initialNames.has(tool.name));
         params.tools = [
             ...convertTools(initialTools, isOAuthToken, compat.supportsEagerToolInputStreaming, compat.supportsStrictTools, toolCacheControl),
             DEFERRED_TOOL_PLACEHOLDER,
-            ...convertTools(laterTools, isOAuthToken, compat.supportsEagerToolInputStreaming, compat.supportsStrictTools).map((tool) => ({ ...tool, defer_loading: true })),
         ];
     }
     else {
@@ -1292,7 +1279,7 @@ function convertToolResult(msg) {
         is_error: msg.isError,
     };
 }
-function convertMessages(transformedMessages, isOAuthToken, cacheControl, allowEmptySignature = false, managedProvider, nativeToolChanges = false) {
+function convertMessages(transformedMessages, isOAuthToken, cacheControl, allowEmptySignature = false, managedProvider, convertToolDefinitions) {
     const params = [];
     const assistantLevels = new Map();
     // Later system messages are held back and emitted directly before the next assistant
@@ -1314,18 +1301,19 @@ function convertMessages(transformedMessages, isOAuthToken, cacheControl, allowE
             const blocks = [];
             if (text.length > 0)
                 blocks.push({ type: "text", text: sanitizeSurrogates(text) });
-            if (nativeToolChanges) {
+            if (convertToolDefinitions) {
+                const added = msg.toolsAdded ?? [];
+                const redefined = new Set(added.map((tool) => tool.name));
                 for (const tool of msg.toolsRemoved ?? []) {
+                    if (redefined.has(tool.name))
+                        continue;
                     blocks.push({
                         type: "tool_removal",
                         tool: { type: "tool_reference", name: isOAuthToken ? toClaudeCodeName(tool.name) : tool.name },
                     });
                 }
-                for (const tool of msg.toolsAdded ?? []) {
-                    blocks.push({
-                        type: "tool_addition",
-                        tool: { type: "tool_reference", name: isOAuthToken ? toClaudeCodeName(tool.name) : tool.name },
-                    });
+                for (const definition of convertToolDefinitions(added)) {
+                    blocks.push({ type: "tool_addition", tool: { type: "tool_definition", definition } });
                 }
             }
             if (blocks.length > 0)