npm - @latimer-woods-tech/llm - Versions diffs - 0.3.1 → 0.4.2 - Mend

@latimer-woods-tech/llm 0.3.1 → 0.4.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (6) hide show

package/CHANGELOG.md CHANGED Viewed

@@ -1,5 +1,114 @@
 # Changelog
+## 0.4.2 — 2026-06-03
+### Added — tool-calling (Agent Runtime Phase 1a; Anthropic)
+- **`LLMOptions.tools`** (`LLMTool[]`) and **`LLMOptions.toolChoice`**
+  (`'auto' | 'none' | { name }`). When `tools` is set, routing **fails closed**
+  to tool-capable providers — failover never silently falls back to one that
+  can't honour the tool schema (1a: Anthropic only; others land in 1b).
+- **`LLMResult.toolCalls`** (`LLMToolCall[]`) and **`LLMResult.stopReason`**
+  (`'end' | 'tool_use' | 'max_tokens' | 'other'`), normalized across providers.
+- **`LLMMessage.content`** now accepts `string | LLMContentBlock[]` — structured
+  `text` / `tool_use` / `tool_result` blocks for multi-turn tool conversations.
+  Backwards-compatible: existing `string` content is unchanged; providers without
+  tool support receive the text projection.
+- New exported types: `LLMTool`, `LLMToolCall`, `LLMContentBlock`.
+### Notes
+- A `tool_use` response with no text content is no longer treated as an empty
+  (failed) completion.
+- Anthropic `tool_use` blocks pass through unchanged (the block shapes mirror the
+  Messages wire format). Other providers' tool formats are normalized in 1a's
+  follow-ups (1b: Grok/DeepSeek/Gemini; 1c: streaming tool-call accumulation).
+---
+## 0.4.1 — 2026-06-03
+### Added (no breaking changes)
+- Export `MODEL_PRICE_PER_1M` — the canonical USD-per-1M-tokens rate table. This
+  makes it the single source of truth for pricing across the platform;
+  `@latimer-woods-tech/llm-meter` now derives its cents table from it and enforces
+  parity with a drift-guard test. Make all rate changes here.
+---
+## 0.3.4 — 2026-05-28
+### Added (no breaking changes)
+- **`workbench` tier** routes to `deepseek-chat` with Groq fallback for boring,
+  reviewable, non-sensitive internal batch work.
+- **`DEEPSEEK_API_KEY`** added as an optional `LLMEnv` binding. It is required only
+  for `tier: 'workbench'` or explicit `deepseek-*` model overrides.
+- **DeepSeek pricing entries** for `deepseek-chat` and `deepseek-reasoner` so cost
+  caps and ledger rows use known rates instead of the conservative Opus fallback.
+### Guardrail
+- `workbench` is for docs summaries, changelog drafts, issue triage, and classification.
+  Do not route secrets, customer PII, billing data, production ops, or final
+  customer-facing answers through DeepSeek.
+---
+## 0.3.3 — 2026-05-27
+### Changed (no breaking changes)
+- **`fast` tier now routes to Grok 4.3 (primary) → Anthropic Haiku (fallback).**
+  When `GROK_API_KEY` is present in `LLMEnv`, the `fast` tier sends completions to
+  `grok-4.3` first and falls back to `claude-haiku-4-20250514` if Grok is unavailable
+  or returns an error. When `GROK_API_KEY` is absent, the request goes directly to
+  Anthropic Haiku (same behaviour as before). Callers that already set `tier: 'fast'`
+  pick up Grok routing automatically; no code change needed.
+### Added
+- **`LLMOptions.reasoningEffort`** — `'none' | 'low' | 'medium' | 'high'`
+  (optional, defaults to `'none'`). Forwarded to the Grok `reasoning_effort` parameter
+  for `grok-4.3`; ignored for all other providers.
+- **`MODELS.grok.fast`** updated from `'grok-4-fast'` to `'grok-4.3'`. Old alias
+  `'grok-4-fast'` retained as deprecated with updated pricing so historical ledger
+  rows remain accurate.
+- **Grok pricing update**: `grok-4.3` at $1.25/$2.50 per MTok (in/out).
+  Old `grok-4-fast` and `grok-3-mini-latest` re-priced to the same $1.25/$2.50 rate.
+- **`for (const [legIndex, leg] of routeLegs.entries())`** — renamed loop variable so
+  `legIndex` is accessible for the last-leg 429 rate-limit short-circuit.
+### Consumers
+- To opt-in to Grok 4.3: add `GROK_API_KEY` to your `LLMEnv` binding. No other code
+  change required for `tier: 'fast'` callers.
+- `GROK_API_KEY` is optional. If absent, fast-tier routing is identical to 0.3.2
+  (Anthropic Haiku only).
+---
+## 0.3.2 — 2026-05-27
+### Added (no breaking changes)
+- **`LLMOptions.workload`** — optional string label (`'insights'`, `'copy'`, `'lead-qualification'`, …)
+  forwarded to cost-recording calls for per-workload cost attribution in dashboards.
+- **Missing model pricing entries** in `MODEL_PRICE_PER_1M`:
+  `claude-haiku-4-5-20251001`, `claude-sonnet-4-20250514`, `claude-opus-4-20250514`
+  (aliases for variants that share pricing with their shorthand names; prevents
+  `estimateCostUsd` from silently returning `$0` for these model IDs).
+- **`workload` forwarded** to `recordOrgCostUsage` so per-workload breakdowns appear
+  in the cost-tracking KV store.
+### Consumers
+- Existing callers do not need to set `workload`; it is optional and defaults to `undefined`.
+- The `recordOrgCostUsage` signature is unchanged; `workload` is an additive internal field.
+---
 ## 0.3.1 — 2026-05-02 PM
 ### Added (no breaking changes)

package/README.md CHANGED Viewed

@@ -1,7 +1,7 @@
 # @latimer-woods-tech/llm
 Tier-routed LLM orchestration for the Factory platform, with Cloudflare AI Gateway, Anthropic
-primary, Gemini 2.5 Pro long-context fallback, and Groq verifier.
+primary, Gemini 2.5 Pro long-context fallback, Groq verifier, and DeepSeek workbench routing.
 ## Routing (0.3.0)
@@ -11,6 +11,7 @@ primary, Gemini 2.5 Pro long-context fallback, and Groq verifier.
 | `balanced` *(default)* | Claude Sonnet 4 | Gemini 2.5 Pro | swaps to Gemini when est. tokens ≥ 150k |
 | `smart` | Claude Opus 4 | Gemini 2.5 Pro | ditto; tools, long reasoning |
 | `verifier` | Groq Llama 3.3 70B | — | cheap second opinion; no fallback |
+| `workbench` | DeepSeek Chat | Groq Llama | boring, reviewable, non-sensitive batch work |
 All traffic flows through `AI_GATEWAY_BASE_URL`. The gateway handles caching, rate-limit shedding,
 and per-project cost telemetry.
@@ -29,6 +30,7 @@ const res = await complete(
     AI_GATEWAY_BASE_URL: env.AI_GATEWAY_BASE_URL,
     ANTHROPIC_API_KEY: env.ANTHROPIC_API_KEY,
     GROQ_API_KEY: env.GROQ_API_KEY,
+    DEEPSEEK_API_KEY: env.DEEPSEEK_API_KEY,
     VERTEX_ACCESS_TOKEN: env.VERTEX_ACCESS_TOKEN,
     VERTEX_PROJECT: env.VERTEX_PROJECT,
     VERTEX_LOCATION: env.VERTEX_LOCATION,
@@ -47,6 +49,11 @@ if (res.ok) {
 }
 ```
+Use `tier: 'workbench'` only for low-risk internal jobs: docs summaries, changelog drafts,
+classification, issue triage, and other outputs a human or higher-trust model can review. Do not
+send secrets, customer PII, production ops requests, billing data, or final customer-facing answers
+through this lane.
 ## Vertex access token
 Minted via the JWT-bearer flow from a GCP service account. See

package/package.json CHANGED Viewed

@@ -1,6 +1,6 @@
 {
   "name": "@latimer-woods-tech/llm",
-  "version": "0.3.1",
+  "version": "0.4.2",
   "private": false,
   "repository": {
     "type": "git",
@@ -26,7 +26,8 @@
     "build": "tsup src/index.ts --format esm --dts",
     "test": "vitest run --coverage",
     "lint": "eslint src --max-warnings 0",
-    "typecheck": "tsc --noEmit"
+    "typecheck": "tsc --noEmit",
+    "prepublish": "npm run lint && npm run typecheck && npm run test && npm run build"
   },
   "dependencies": {
     "@latimer-woods-tech/errors": "^0.2.0",

package/dist/index.d.mts DELETED Viewed

@@ -1,206 +0,0 @@
-import { FactoryResponse } from '@latimer-woods-tech/errors';
-import { Logger } from '@latimer-woods-tech/logger';
-/**
- * Single chat message exchanged with an LLM provider.
- */
-interface LLMMessage {
-    role: 'user' | 'assistant' | 'system';
-    content: string;
-}
-/**
- * Quality tier selected by the caller. Routing is workload-split:
- *  - `fast`      → Anthropic Haiku (short, latency-sensitive)
- *  - `balanced`  → Anthropic Sonnet (default)
- *  - `smart`     → Anthropic Opus OR Gemini 2.5 Pro if input is long-context (>150k tokens estimated)
- *  - `verifier`  → Groq Llama (cheap second opinion; only used from verifier code path)
- */
-type LLMTier = 'fast' | 'balanced' | 'smart' | 'verifier';
-/**
- * Options that influence LLM completion behaviour.
- */
-interface LLMOptions {
-    /** Quality tier; see {@link LLMTier}. Defaults to `balanced`. */
-    tier?: LLMTier;
-    /** Explicit model override. Takes precedence over tier. */
-    model?: string;
-    maxTokens?: number;
-    temperature?: number;
-    system?: string;
-    /** Token budget above which we force long-context routing (Gemini). */
-    longContextThreshold?: number;
-    /** Per-call cancellation signal. Aborts the in-flight provider request. */
-    signal?: AbortSignal;
-    /** Optional run identifier stamped on ledger rows + logs. */
-    runId?: string;
-    /** Optional project identifier stamped on ledger rows + logs. */
-    project?: string;
-    /** Optional actor identifier (supervisor / worker / human). */
-    actor?: string;
-    /** Anthropic prompt-cache control. Defaults to `true` for `system` prompts ≥ 1024 tokens. */
-    promptCache?: boolean;
-}
-/**
- * Provider that produced an LLM response. `grok` removed in 0.3.0.
- */
-type LLMProvider = 'anthropic' | 'gemini' | 'groq' | 'grok';
-/**
- * Result returned by a successful completion.
- */
-interface LLMResult {
-    content: string;
-    provider: LLMProvider;
-    model: string;
-    tier: LLMTier;
-    tokens: {
-        input: number;
-        output: number;
-        cacheRead?: number;
-        cacheWrite?: number;
-    };
-    latency: number;
-    /** Number of attempts before success (1 = primary succeeded). */
-    attempts: number;
-    /** Monotonic request id from AI Gateway, if present in headers. */
-    gatewayRequestId?: string;
-}
-/**
- * Environment bindings required by {@link complete}.
- *
- * `AI_GATEWAY_BASE_URL` is REQUIRED in 0.3.0. All provider calls flow through the
- * Cloudflare AI Gateway for unified logging, rate limiting, and cost telemetry.
- * In test/dev the caller may pass a custom fetch impl that short-circuits this.
- */
-interface LLMEnv {
-    AI_GATEWAY_BASE_URL: string;
-    ANTHROPIC_API_KEY: string;
-    GROQ_API_KEY: string;
-    /** Optional — only required when caller passes `{ model: 'grok-*' }` override. */
-    GROK_API_KEY?: string;
-    /**
-     * Google Cloud short-lived access token with `aiplatform.endpoints.predict`.
-     * Callers mint this via the JWT-bearer flow (service account → token exchange);
-     * see `docs/runbooks/rotate-gcp-sa.md`. Token must be valid for ≥ 5 minutes.
-     */
-    VERTEX_ACCESS_TOKEN: string;
-    VERTEX_PROJECT: string;
-    VERTEX_LOCATION: string;
-}
-/**
- * Optional dependencies for {@link complete}.
- */
-interface LLMDeps {
-    fetch?: typeof fetch;
-    logger?: Logger;
-    now?: () => number;
-}
-declare const MODELS: {
-    readonly anthropic: {
-        readonly fast: "claude-haiku-4-20250514";
-        readonly balanced: "claude-sonnet-4-6";
-        readonly smart: "claude-opus-4-7";
-    };
-    readonly gemini: {
-        readonly smart: "gemini-2.5-pro";
-    };
-    readonly groq: {
-        readonly verifier: "llama-3.3-70b-versatile";
-    };
-    readonly grok: {
-        /** Opt-in only via `{ model: 'grok-*' }`. Not in default tier routing. */
-        readonly fast: "grok-4-fast";
-        readonly mini: "grok-3-mini-latest";
-    };
-};
-/** Cooldown duration in ms after a provider exhausts all retries. */
-declare const PROVIDER_COOLDOWN_MS = 30000;
-/**
- * Returns `true` if the provider is currently in its cooldown window.
- * Uses the injected `now` function (or `Date.now`) for testability.
- */
-declare function isProviderCoolingDown(provider: LLMProvider, now?: () => number): boolean;
-/**
- * Marks a provider as cooling down for {@link PROVIDER_COOLDOWN_MS} milliseconds.
- */
-declare function markProviderCoolingDown(provider: LLMProvider, now?: () => number): void;
-/**
- * Clears the cooldown state for a provider after a successful call.
- */
-declare function clearProviderCooldown(provider: LLMProvider): void;
-declare const BASE_BACKOFF_MS = 250;
-/**
- * Run a completion through the routing plan for the requested tier.
- *
- * Routing summary (0.3.0):
- *   - `fast`     → Anthropic Haiku
- *   - `balanced` → Anthropic Sonnet; Gemini 2.5 Pro if `longContextThreshold` exceeded
- *   - `smart`    → Anthropic Opus; Gemini 2.5 Pro if long-context
- *   - `verifier` → Groq Llama 3.3 70B (no fallback — verifier is inherently cheap/best-effort)
- *
- * All provider traffic flows through Cloudflare AI Gateway at `AI_GATEWAY_BASE_URL`.
- *
- * Per-provider reliability guarantees (0.4.0):
- *   - Exponential backoff with jitter on 429 / 5xx (base 500ms, cap 8s, up to 2 retries).
- *   - Provider cooldown: after exhausting retries the provider is marked cooling down
- *     for 30 seconds; subsequent calls skip it and go straight to the fallback leg.
- *
- * @param messages - Ordered chat history.
- * @param env - API key + gateway bindings.
- * @param opts - Optional tier/model/parameters override.
- * @param deps - Optional fetch/logger/clock injection (for testing).
- * @returns A {@link FactoryResponse} carrying either an {@link LLMResult} or
- *   an error (`LLM_ALL_PROVIDERS_FAILED`, `LLM_RATE_LIMITED`, or `INTERNAL_ERROR`).
- */
-declare function complete(messages: LLMMessage[], env: LLMEnv, opts?: LLMOptions, deps?: LLMDeps): Promise<FactoryResponse<LLMResult>>;
-/**
- * Streams a completion from the primary Anthropic provider, yielding text chunks
- * as they arrive. Falls back to the non-streaming {@link complete} function when
- * the provider does not support streaming (i.e. a non-Anthropic primary is selected).
- *
- * The generator's **return value** (accessible via `gen.return()` or by consuming
- * the full iteration) is an {@link LLMResult} with the same shape as {@link complete}.
- *
- * Usage pattern:
- * ```ts
- * const gen = completionStream(messages, env, opts);
- * for await (const chunk of gen) {
- *   // stream chunk to client
- * }
- * const result = (await gen.return(undefined)).value; // LLMResult
- * ```
- *
- * @param messages - Ordered chat history.
- * @param env - API key + gateway bindings.
- * @param opts - Optional tier/model/parameters override. Accepts `deps` as nested field.
- * @returns An async generator that yields `string` chunks and returns an {@link LLMResult}.
- */
-declare function completionStream(messages: LLMMessage[], env: LLMEnv, opts?: LLMOptions & {
-    deps?: LLMDeps;
-}): AsyncGenerator<string, LLMResult, unknown>;
-/**
- * Returns `true` if `response` contains at least one verbatim phrase of at
- * least 5 consecutive whitespace-delimited tokens that also appears in one of
- * the `sources` strings.
- *
- * Returns `true` unconditionally when `sources` is empty (no grounding
- * documents means grounding cannot be violated).
- *
- * This is a lightweight guard for RAG pipelines — it detects obvious
- * hallucinations where the model generates content not present in any
- * retrieved source. It is NOT a semantic similarity check.
- *
- * @param response - The LLM-generated text to inspect.
- * @param sources - Retrieved source documents to check against.
- * @returns `true` if the response is grounded, `false` if hallucination detected.
- *
- * @example
- * ```ts
- * const grounded = assertGrounding(llmAnswer, retrievedDocs);
- * if (!grounded) {
- *   // flag or re-rank the response
- * }
- * ```
- */
-declare function assertGrounding(response: string, sources: string[]): boolean;
-export { BASE_BACKOFF_MS, type LLMDeps, type LLMEnv, type LLMMessage, type LLMOptions, type LLMProvider, type LLMResult, type LLMTier, MODELS, PROVIDER_COOLDOWN_MS, assertGrounding, clearProviderCooldown, complete, completionStream, isProviderCoolingDown, markProviderCoolingDown };

package/dist/index.mjs DELETED Viewed

@@ -1,583 +0,0 @@
-// src/index.ts
-import {
-  InternalError,
-  RateLimitError,
-  ValidationError,
-  toErrorResponse
-} from "@latimer-woods-tech/errors";
-var MODELS = {
-  anthropic: {
-    fast: "claude-haiku-4-20250514",
-    balanced: "claude-sonnet-4-6",
-    smart: "claude-opus-4-7"
-  },
-  gemini: {
-    smart: "gemini-2.5-pro"
-  },
-  groq: {
-    verifier: "llama-3.3-70b-versatile"
-  },
-  grok: {
-    /** Opt-in only via `{ model: 'grok-*' }`. Not in default tier routing. */
-    fast: "grok-4-fast",
-    mini: "grok-3-mini-latest"
-  }
-};
-var DEFAULT_MAX_TOKENS = 1024;
-var DEFAULT_TEMPERATURE = 0.7;
-var DEFAULT_LONG_CONTEXT_THRESHOLD = 15e4;
-var BACKOFF_BASE_MS = 500;
-var BACKOFF_CAP_MS = 8e3;
-var BACKOFF_JITTER_MAX_MS = 250;
-var PER_PROVIDER_MAX_ATTEMPTS = 3;
-var providerCooldownUntil = /* @__PURE__ */ new Map();
-var PROVIDER_COOLDOWN_MS = 3e4;
-function isProviderCoolingDown(provider, now = Date.now) {
-  const until = providerCooldownUntil.get(provider);
-  if (until === void 0) return false;
-  return now() < until;
-}
-function markProviderCoolingDown(provider, now = Date.now) {
-  providerCooldownUntil.set(provider, now() + PROVIDER_COOLDOWN_MS);
-}
-function clearProviderCooldown(provider) {
-  providerCooldownUntil.delete(provider);
-}
-var BASE_BACKOFF_MS = 250;
-function isRetryableForBackoff(status) {
-  return status === 429 || status >= 500 && status < 600;
-}
-function estimateTokens(messages, system) {
-  let chars = system?.length ?? 0;
-  for (const m of messages) chars += m.content.length;
-  return Math.ceil(chars / 4);
-}
-function sleep(ms, signal) {
-  return new Promise((resolve, reject) => {
-    const t = setTimeout(resolve, ms);
-    if (signal) {
-      const onAbort = () => {
-        clearTimeout(t);
-        reject(new DOMException("Aborted", "AbortError"));
-      };
-      if (signal.aborted) onAbort();
-      else signal.addEventListener("abort", onAbort, { once: true });
-    }
-  });
-}
-function computeBackoffMs(attempt) {
-  const jitter = Math.floor(Math.random() * BACKOFF_JITTER_MAX_MS);
-  return Math.min(BACKOFF_BASE_MS * Math.pow(2, attempt) + jitter, BACKOFF_CAP_MS);
-}
-function buildAnthropicRequest(model, messages, opts, env, streaming = false) {
-  const sys = opts.system ?? messages.find((m) => m.role === "system")?.content;
-  const filtered = messages.filter((m) => m.role !== "system");
-  const body = {
-    model,
-    max_tokens: opts.maxTokens ?? DEFAULT_MAX_TOKENS,
-    temperature: opts.temperature ?? DEFAULT_TEMPERATURE,
-    messages: filtered.map((m) => ({ role: m.role, content: m.content }))
-  };
-  if (streaming) {
-    body.stream = true;
-  }
-  if (sys) {
-    const cache = opts.promptCache ?? sys.length >= 4096;
-    body.system = cache ? [{ type: "text", text: sys, cache_control: { type: "ephemeral" } }] : sys;
-  }
-  return {
-    url: `${env.AI_GATEWAY_BASE_URL}/anthropic/v1/messages`,
-    headers: {
-      "content-type": "application/json",
-      "x-api-key": env.ANTHROPIC_API_KEY,
-      "anthropic-version": "2023-06-01",
-      "anthropic-beta": "prompt-caching-2024-07-31"
-    },
-    body: JSON.stringify(body)
-  };
-}
-function buildGeminiRequest(model, messages, opts, env) {
-  const sys = opts.system ?? messages.find((m) => m.role === "system")?.content;
-  const contents = messages.filter((m) => m.role !== "system").map((m) => ({
-    role: m.role === "assistant" ? "model" : "user",
-    parts: [{ text: m.content }]
-  }));
-  const body = {
-    contents,
-    generationConfig: {
-      maxOutputTokens: opts.maxTokens ?? DEFAULT_MAX_TOKENS,
-      temperature: opts.temperature ?? DEFAULT_TEMPERATURE
-    }
-  };
-  if (sys) {
-    body.systemInstruction = { parts: [{ text: sys }] };
-  }
-  const path = `v1/projects/${env.VERTEX_PROJECT}/locations/${env.VERTEX_LOCATION}/publishers/google/models/${model}:generateContent`;
-  return {
-    url: `${env.AI_GATEWAY_BASE_URL}/google-vertex-ai/${path}`,
-    headers: {
-      "content-type": "application/json",
-      authorization: `Bearer ${env.VERTEX_ACCESS_TOKEN}`
-    },
-    body: JSON.stringify(body)
-  };
-}
-function buildGroqRequest(model, messages, opts, env) {
-  const sys = opts.system ?? messages.find((m) => m.role === "system")?.content;
-  const merged = [];
-  if (sys) merged.push({ role: "system", content: sys });
-  for (const m of messages) if (m.role !== "system") merged.push(m);
-  return {
-    url: `${env.AI_GATEWAY_BASE_URL}/groq/openai/v1/chat/completions`,
-    headers: {
-      "content-type": "application/json",
-      authorization: `Bearer ${env.GROQ_API_KEY}`
-    },
-    body: JSON.stringify({
-      model,
-      max_tokens: opts.maxTokens ?? DEFAULT_MAX_TOKENS,
-      temperature: opts.temperature ?? DEFAULT_TEMPERATURE,
-      messages: merged
-    })
-  };
-}
-function buildGrokRequest(model, messages, opts, env) {
-  if (!env.GROK_API_KEY) {
-    throw new ValidationError("GROK_API_KEY required for grok-* model override");
-  }
-  const sys = opts.system ?? messages.find((m) => m.role === "system")?.content;
-  const merged = [];
-  if (sys) merged.push({ role: "system", content: sys });
-  for (const m of messages) if (m.role !== "system") merged.push(m);
-  return {
-    url: `${env.AI_GATEWAY_BASE_URL}/grok/v1/chat/completions`,
-    headers: {
-      "content-type": "application/json",
-      authorization: `Bearer ${env.GROK_API_KEY}`
-    },
-    body: JSON.stringify({
-      model,
-      max_tokens: opts.maxTokens ?? DEFAULT_MAX_TOKENS,
-      temperature: opts.temperature ?? DEFAULT_TEMPERATURE,
-      messages: merged
-    })
-  };
-}
-function parseAnthropic(json) {
-  const r = json;
-  return {
-    content: r.content?.find((c) => c.type === "text")?.text ?? "",
-    input: r.usage?.input_tokens ?? 0,
-    output: r.usage?.output_tokens ?? 0,
-    cacheRead: r.usage?.cache_read_input_tokens ?? 0,
-    cacheWrite: r.usage?.cache_creation_input_tokens ?? 0,
-    model: r.model
-  };
-}
-function parseGemini(json) {
-  const r = json;
-  const text = r.candidates?.[0]?.content?.parts?.map((p) => p.text ?? "").join("") ?? "";
-  return {
-    content: text,
-    input: r.usageMetadata?.promptTokenCount ?? 0,
-    output: r.usageMetadata?.candidatesTokenCount ?? 0
-  };
-}
-function parseGroq(json) {
-  const r = json;
-  return {
-    content: r.choices?.[0]?.message?.content ?? "",
-    input: r.usage?.prompt_tokens ?? 0,
-    output: r.usage?.completion_tokens ?? 0,
-    model: r.model
-  };
-}
-async function callWithBackoff(provider, request, fetchImpl, signal, logger, nowFn) {
-  function exhaustAndThrow(err) {
-    markProviderCoolingDown(provider, nowFn ?? Date.now);
-    throw err;
-  }
-  let lastErr;
-  for (let attempt = 1; attempt <= PER_PROVIDER_MAX_ATTEMPTS; attempt++) {
-    try {
-      const response = await fetchImpl(request.url, {
-        method: "POST",
-        headers: request.headers,
-        body: request.body,
-        signal
-      });
-      if (!response.ok) {
-        const text = await response.text().catch(() => "");
-        const retryable = isRetryableForBackoff(response.status);
-        const err = {
-          provider,
-          status: response.status,
-          retryable,
-          message: `${provider} ${String(response.status)}: ${text.slice(0, 300)}`
-        };
-        logger?.warn?.("llm.provider.error", { provider, status: response.status, attempt });
-        if (!err.retryable || attempt === PER_PROVIDER_MAX_ATTEMPTS) {
-          if (err.retryable) exhaustAndThrow(err);
-          throw err;
-        }
-        lastErr = err;
-      } else {
-        const gatewayRequestId = response.headers.get("cf-aig-request-id") ?? void 0;
-        clearProviderCooldown(provider);
-        return { json: await response.json(), gatewayRequestId, attempts: attempt };
-      }
-    } catch (e) {
-      if (e instanceof DOMException && e.name === "AbortError") throw e;
-      if (typeof e === "object" && e !== null && "retryable" in e) {
-        const err = e;
-        if (!err.retryable || attempt === PER_PROVIDER_MAX_ATTEMPTS) {
-          if (err.retryable) exhaustAndThrow(err);
-          throw err;
-        }
-        lastErr = err;
-      } else {
-        const err = {
-          provider,
-          status: 0,
-          retryable: true,
-          message: e instanceof Error ? e.message : String(e)
-        };
-        if (attempt === PER_PROVIDER_MAX_ATTEMPTS) exhaustAndThrow(err);
-        lastErr = err;
-      }
-    }
-    const backoffMs = computeBackoffMs(attempt - 1);
-    await sleep(backoffMs, signal);
-  }
-  markProviderCoolingDown(provider, nowFn ?? Date.now);
-  throw lastErr ?? { provider, status: 0, retryable: false, message: "exhausted" };
-}
-function isProviderError(err) {
-  return typeof err === "object" && err !== null && typeof err.status === "number" && typeof err.message === "string" && typeof err.provider === "string";
-}
-function plan(tier, opts, tokenEstimate) {
-  if (opts.model) {
-    const m = opts.model;
-    if (m.startsWith("claude")) return { primary: { provider: "anthropic", model: m } };
-    if (m.startsWith("gemini")) return { primary: { provider: "gemini", model: m } };
-    if (m.startsWith("grok")) return { primary: { provider: "grok", model: m } };
-    return { primary: { provider: "groq", model: m } };
-  }
-  const longContext = tokenEstimate >= (opts.longContextThreshold ?? DEFAULT_LONG_CONTEXT_THRESHOLD);
-  switch (tier) {
-    case "verifier":
-      return { primary: { provider: "groq", model: MODELS.groq.verifier } };
-    case "smart":
-      return longContext ? {
-        primary: { provider: "gemini", model: MODELS.gemini.smart },
-        fallback: { provider: "anthropic", model: MODELS.anthropic.smart }
-      } : {
-        primary: { provider: "anthropic", model: MODELS.anthropic.smart },
-        fallback: { provider: "gemini", model: MODELS.gemini.smart }
-      };
-    case "fast":
-      return { primary: { provider: "anthropic", model: MODELS.anthropic.fast } };
-    case "balanced":
-    default:
-      return longContext ? {
-        primary: { provider: "gemini", model: MODELS.gemini.smart },
-        fallback: { provider: "anthropic", model: MODELS.anthropic.balanced }
-      } : {
-        primary: { provider: "anthropic", model: MODELS.anthropic.balanced },
-        fallback: { provider: "gemini", model: MODELS.gemini.smart }
-      };
-  }
-}
-async function callOne(leg, messages, opts, env, fetchImpl, logger, nowFn) {
-  let req;
-  switch (leg.provider) {
-    case "anthropic":
-      req = buildAnthropicRequest(leg.model, messages, opts, env);
-      break;
-    case "gemini":
-      req = buildGeminiRequest(leg.model, messages, opts, env);
-      break;
-    case "groq":
-      req = buildGroqRequest(leg.model, messages, opts, env);
-      break;
-    case "grok":
-      req = buildGrokRequest(leg.model, messages, opts, env);
-      break;
-  }
-  const { json, gatewayRequestId, attempts } = await callWithBackoff(
-    leg.provider,
-    req,
-    fetchImpl,
-    opts.signal,
-    logger,
-    nowFn
-  );
-  switch (leg.provider) {
-    case "anthropic":
-      return { parsed: parseAnthropic(json), gatewayRequestId, attempts };
-    case "gemini":
-      return { parsed: parseGemini(json), gatewayRequestId, attempts };
-    case "groq":
-      return { parsed: parseGroq(json), gatewayRequestId, attempts };
-    case "grok":
-      return { parsed: parseGroq(json), gatewayRequestId, attempts };
-  }
-}
-async function complete(messages, env, opts = {}, deps = {}) {
-  if (messages.length === 0) {
-    throw new ValidationError("messages must not be empty");
-  }
-  if (!env.AI_GATEWAY_BASE_URL) {
-    throw new ValidationError("AI_GATEWAY_BASE_URL is required in 0.3.0");
-  }
-  const fetchImpl = deps.fetch ?? fetch;
-  const now = deps.now ?? (() => Date.now());
-  const logger = deps.logger;
-  const startedAt = now();
-  const tier = opts.tier ?? "balanced";
-  const system = opts.system ?? messages.find((m) => m.role === "system")?.content;
-  const tokenEstimate = estimateTokens(messages, system);
-  const route = plan(tier, opts, tokenEstimate);
-  const attemptLog = [];
-  for (const leg of [route.primary, route.fallback].filter(Boolean)) {
-    if (isProviderCoolingDown(leg.provider, now)) {
-      logger?.warn?.("llm.provider.coolingDown", { provider: leg.provider });
-      attemptLog.push({ provider: leg.provider, message: "skipped: cooling down" });
-      continue;
-    }
-    try {
-      const result = await callOne(leg, messages, opts, env, fetchImpl, logger, now);
-      if (!result.parsed.content) {
-        throw { provider: leg.provider, status: 200, retryable: false, message: "empty content" };
-      }
-      logger?.info?.("llm.complete", {
-        provider: leg.provider,
-        model: leg.model,
-        tier,
-        tokenEstimate,
-        attempts: result.attempts,
-        runId: opts.runId,
-        project: opts.project,
-        actor: opts.actor
-      });
-      return {
-        data: {
-          content: result.parsed.content,
-          provider: leg.provider,
-          model: result.parsed.model ?? leg.model,
-          tier,
-          tokens: {
-            input: result.parsed.input,
-            output: result.parsed.output,
-            cacheRead: result.parsed.cacheRead,
-            cacheWrite: result.parsed.cacheWrite
-          },
-          latency: now() - startedAt,
-          attempts: result.attempts,
-          gatewayRequestId: result.gatewayRequestId
-        },
-        error: null
-      };
-    } catch (e) {
-      if (e instanceof DOMException && e.name === "AbortError") {
-        return toErrorResponse(
-          new InternalError("llm call aborted", { provider: leg.provider, model: leg.model })
-        );
-      }
-      if (isProviderError(e)) {
-        attemptLog.push({ provider: e.provider, status: e.status, message: e.message });
-        if (e.status === 429 && !route.fallback) {
-          return toErrorResponse(
-            new RateLimitError(`llm rate limited on ${e.provider}`, { attempts: attemptLog })
-          );
-        }
-        logger?.warn?.("llm.leg.failed", { provider: leg.provider, status: e.status });
-        continue;
-      }
-      attemptLog.push({ provider: leg.provider, message: e instanceof Error ? e.message : String(e) });
-    }
-  }
-  return toErrorResponse(
-    new InternalError("LLM_ALL_PROVIDERS_FAILED", { attempts: attemptLog, tier, tokenEstimate })
-  );
-}
-async function* completionStream(messages, env, opts = {}) {
-  if (messages.length === 0) {
-    throw new ValidationError("messages must not be empty");
-  }
-  if (!env.AI_GATEWAY_BASE_URL) {
-    throw new ValidationError("AI_GATEWAY_BASE_URL is required in 0.3.0");
-  }
-  const deps = opts.deps ?? {};
-  const fetchImpl = deps.fetch ?? fetch;
-  const now = deps.now ?? (() => Date.now());
-  const logger = deps.logger;
-  const startedAt = now();
-  const tier = opts.tier ?? "balanced";
-  const system = opts.system ?? messages.find((m) => m.role === "system")?.content;
-  const tokenEstimate = estimateTokens(messages, system);
-  const route = plan(tier, opts, tokenEstimate);
-  if (route.primary.provider !== "anthropic") {
-    const result = await complete(messages, env, opts, deps);
-    if (result.error !== null || result.data === null) {
-      throw new InternalError("LLM_ALL_PROVIDERS_FAILED", { error: result.error });
-    }
-    yield result.data.content;
-    return result.data;
-  }
-  if (isProviderCoolingDown(route.primary.provider, now)) {
-    logger?.warn?.("llm.provider.coolingDown", { provider: route.primary.provider });
-    const result = await complete(messages, env, opts, deps);
-    if (result.error !== null || result.data === null) {
-      throw new InternalError("LLM_ALL_PROVIDERS_FAILED", { error: result.error });
-    }
-    yield result.data.content;
-    return result.data;
-  }
-  const req = buildAnthropicRequest(route.primary.model, messages, opts, env, true);
-  let response;
-  try {
-    response = await fetchImpl(req.url, {
-      method: "POST",
-      headers: req.headers,
-      body: req.body,
-      // Fall back to a 60 s default when the caller provides no signal — prevents
-      // a hung provider connection from consuming the Worker's wall-clock budget.
-      signal: opts.signal ?? AbortSignal.timeout(6e4)
-    });
-  } catch (e) {
-    if (e instanceof DOMException && e.name === "AbortError") {
-      throw new InternalError("llm call aborted", {
-        provider: route.primary.provider,
-        model: route.primary.model
-      });
-    }
-    throw new InternalError("llm stream fetch failed", {
-      message: e instanceof Error ? e.message : String(e)
-    });
-  }
-  if (!response.ok) {
-    const text = await response.text().catch(() => "");
-    const retryable = isRetryableForBackoff(response.status);
-    if (retryable && response.status === 429) {
-      markProviderCoolingDown(route.primary.provider, now);
-    }
-    const result = await complete(messages, env, opts, deps);
-    if (result.error !== null || result.data === null) {
-      throw new InternalError("LLM_ALL_PROVIDERS_FAILED", {
-        streamError: `${route.primary.provider} ${String(response.status)}: ${text.slice(0, 300)}`,
-        error: result.error
-      });
-    }
-    yield result.data.content;
-    return result.data;
-  }
-  if (!response.body) {
-    throw new InternalError("llm stream response body is null", {
-      provider: route.primary.provider
-    });
-  }
-  const decoder = new TextDecoder();
-  let accumulatedText = "";
-  let inputTokens = 0;
-  let outputTokens = 0;
-  let cacheRead = 0;
-  let cacheWrite = 0;
-  let modelName;
-  const gatewayRequestId = response.headers.get("cf-aig-request-id") ?? void 0;
-  const reader = response.body.getReader();
-  let buffer = "";
-  try {
-    while (true) {
-      const { done, value } = await reader.read();
-      if (done) break;
-      buffer += decoder.decode(value, { stream: true });
-      const lines = buffer.split("\n");
-      buffer = lines.pop() ?? "";
-      for (const line of lines) {
-        if (!line.startsWith("data: ")) continue;
-        const data = line.slice(6).trim();
-        if (data === "[DONE]") break;
-        let event;
-        try {
-          event = JSON.parse(data);
-        } catch {
-          continue;
-        }
-        switch (event.type) {
-          case "message_start":
-            inputTokens = event.message?.usage?.input_tokens ?? 0;
-            cacheRead = event.message?.usage?.cache_read_input_tokens ?? 0;
-            cacheWrite = event.message?.usage?.cache_creation_input_tokens ?? 0;
-            modelName = event.message?.model;
-            break;
-          case "content_block_delta":
-            if (event.delta?.type === "text_delta" && typeof event.delta.text === "string") {
-              accumulatedText += event.delta.text;
-              yield event.delta.text;
-            }
-            break;
-          case "message_delta":
-            outputTokens = event.usage?.output_tokens ?? outputTokens;
-            break;
-          default:
-            break;
-        }
-      }
-    }
-  } finally {
-    reader.releaseLock();
-  }
-  clearProviderCooldown(route.primary.provider);
-  logger?.info?.("llm.completionStream", {
-    provider: route.primary.provider,
-    model: route.primary.model,
-    tier,
-    tokenEstimate,
-    runId: opts.runId,
-    project: opts.project,
-    actor: opts.actor
-  });
-  return {
-    content: accumulatedText,
-    provider: route.primary.provider,
-    model: modelName ?? route.primary.model,
-    tier,
-    tokens: { input: inputTokens, output: outputTokens, cacheRead, cacheWrite },
-    latency: now() - startedAt,
-    attempts: 1,
-    gatewayRequestId
-  };
-}
-function assertGrounding(response, sources) {
-  if (sources.length === 0) return true;
-  const WINDOW = 5;
-  const responseTokens = response.split(/\s+/).filter((t) => t.length > 0);
-  if (responseTokens.length < WINDOW) return false;
-  const sourceNgrams = /* @__PURE__ */ new Set();
-  for (const source of sources) {
-    const tokens = source.split(/\s+/).filter((t) => t.length > 0);
-    for (let i = 0; i <= tokens.length - WINDOW; i++) {
-      const ngram = tokens.slice(i, i + WINDOW).join(" ");
-      sourceNgrams.add(ngram);
-    }
-  }
-  if (sourceNgrams.size === 0) return false;
-  for (let i = 0; i <= responseTokens.length - WINDOW; i++) {
-    const ngram = responseTokens.slice(i, i + WINDOW).join(" ");
-    if (sourceNgrams.has(ngram)) return true;
-  }
-  return false;
-}
-export {
-  BASE_BACKOFF_MS,
-  MODELS,
-  PROVIDER_COOLDOWN_MS,
-  assertGrounding,
-  clearProviderCooldown,
-  complete,
-  completionStream,
-  isProviderCoolingDown,
-  markProviderCoolingDown
-};
-//# sourceMappingURL=index.mjs.map

package/dist/index.mjs.map DELETED Viewed

@@ -1 +0,0 @@

- {"version":3,"sources":["../src/index.ts"],"sourcesContent":["import {\n InternalError,\n RateLimitError,\n ValidationError,\n toErrorResponse,\n type FactoryResponse,\n} from '@latimer-woods-tech/errors';\nimport type { Logger } from '@latimer-woods-tech/logger';\n\n/**\n * Single chat message exchanged with an LLM provider.\n */\nexport interface LLMMessage {\n role: 'user' | 'assistant' | 'system';\n content: string;\n}\n\n/**\n * Quality tier selected by the caller. Routing is workload-split:\n * - `fast` → Anthropic Haiku (short, latency-sensitive)\n * - `balanced` → Anthropic Sonnet (default)\n * - `smart` → Anthropic Opus OR Gemini 2.5 Pro if input is long-context (>150k tokens estimated)\n * - `verifier` → Groq Llama (cheap second opinion; only used from verifier code path)\n */\nexport type LLMTier = 'fast' | 'balanced' | 'smart' | 'verifier';\n\n/**\n * Options that influence LLM completion behaviour.\n */\nexport interface LLMOptions {\n /** Quality tier; see {@link LLMTier}. Defaults to `balanced`. */\n tier?: LLMTier;\n /** Explicit model override. Takes precedence over tier. */\n model?: string;\n maxTokens?: number;\n temperature?: number;\n system?: string;\n /** Token budget above which we force long-context routing (Gemini). */\n longContextThreshold?: number;\n /** Per-call cancellation signal. Aborts the in-flight provider request. */\n signal?: AbortSignal;\n /** Optional run identifier stamped on ledger rows + logs. */\n runId?: string;\n /** Optional project identifier stamped on ledger rows + logs. */\n project?: string;\n /** Optional actor identifier (supervisor / worker / human). */\n actor?: string;\n /** Anthropic prompt-cache control. Defaults to `true` for `system` prompts ≥ 1024 tokens. */\n promptCache?: boolean;\n}\n\n/**\n * Provider that produced an LLM response. `grok` removed in 0.3.0.\n */\nexport type LLMProvider = 'anthropic' | 'gemini' | 'groq' | 'grok';\n\n/**\n * Result returned by a successful completion.\n */\nexport interface LLMResult {\n content: string;\n provider: LLMProvider;\n model: string;\n tier: LLMTier;\n tokens: { input: number; output: number; cacheRead?: number; cacheWrite?: number };\n latency: number;\n /** Number of attempts before success (1 = primary succeeded). */\n attempts: number;\n /** Monotonic request id from AI Gateway, if present in headers. */\n gatewayRequestId?: string;\n}\n\n/**\n * Environment bindings required by {@link complete}.\n *\n * `AI_GATEWAY_BASE_URL` is REQUIRED in 0.3.0. All provider calls flow through the\n * Cloudflare AI Gateway for unified logging, rate limiting, and cost telemetry.\n * In test/dev the caller may pass a custom fetch impl that short-circuits this.\n */\nexport interface LLMEnv {\n AI_GATEWAY_BASE_URL: string;\n ANTHROPIC_API_KEY: string;\n GROQ_API_KEY: string;\n /** Optional — only required when caller passes `{ model: 'grok-*' }` override. */\n GROK_API_KEY?: string;\n /**\n * Google Cloud short-lived access token with `aiplatform.endpoints.predict`.\n * Callers mint this via the JWT-bearer flow (service account → token exchange);\n * see `docs/runbooks/rotate-gcp-sa.md`. Token must be valid for ≥ 5 minutes.\n */\n VERTEX_ACCESS_TOKEN: string;\n VERTEX_PROJECT: string;\n VERTEX_LOCATION: string;\n}\n\n/**\n * Optional dependencies for {@link complete}.\n */\nexport interface LLMDeps {\n fetch?: typeof fetch;\n logger?: Logger;\n now?: () => number;\n}\n\n// Model catalogue — keep in sync with docs/architecture/FACTORY_V1.md § LLM substrate.\nconst MODELS = {\n anthropic: {\n fast: 'claude-haiku-4-20250514',\n balanced: 'claude-sonnet-4-6',\n smart: 'claude-opus-4-7',\n },\n gemini: {\n smart: 'gemini-2.5-pro',\n },\n groq: {\n verifier: 'llama-3.3-70b-versatile',\n },\n grok: {\n /** Opt-in only via `{ model: 'grok-*' }`. Not in default tier routing. */\n fast: 'grok-4-fast',\n mini: 'grok-3-mini-latest',\n },\n} as const;\n\nconst DEFAULT_MAX_TOKENS = 1024;\nconst DEFAULT_TEMPERATURE = 0.7;\nconst DEFAULT_LONG_CONTEXT_THRESHOLD = 150_000; // tokens\n\n// ─── Per-provider exponential backoff constants ────────────────────────────\n/** Base delay in ms for the first retry. */\nconst BACKOFF_BASE_MS = 500;\n/** Maximum backoff cap in ms. */\nconst BACKOFF_CAP_MS = 8_000;\n/** Max random jitter added to each backoff delay, in ms. */\nconst BACKOFF_JITTER_MAX_MS = 250;\n/** Maximum number of attempts per provider (1 initial + 2 retries). */\nconst PER_PROVIDER_MAX_ATTEMPTS = 3;\n\n// ─── Per-provider cooldown state (module-level) ────────────────────────────\n/**\n * Tracks when a provider's cooldown period expires.\n * Keyed by {@link LLMProvider}; value is the `Date.now()` epoch ms at which\n * the cooldown expires. Absent key means \"not cooling down\".\n */\nconst providerCooldownUntil: Map<LLMProvider, number> = new Map();\n\n/** Cooldown duration in ms after a provider exhausts all retries. */\nconst PROVIDER_COOLDOWN_MS = 30_000;\n\n/**\n * Returns `true` if the provider is currently in its cooldown window.\n * Uses the injected `now` function (or `Date.now`) for testability.\n */\nfunction isProviderCoolingDown(provider: LLMProvider, now: () => number = Date.now): boolean {\n const until = providerCooldownUntil.get(provider);\n if (until === undefined) return false;\n return now() < until;\n}\n\n/**\n * Marks a provider as cooling down for {@link PROVIDER_COOLDOWN_MS} milliseconds.\n */\nfunction markProviderCoolingDown(provider: LLMProvider, now: () => number = Date.now): void {\n providerCooldownUntil.set(provider, now() + PROVIDER_COOLDOWN_MS);\n}\n\n/**\n * Clears the cooldown state for a provider after a successful call.\n */\nfunction clearProviderCooldown(provider: LLMProvider): void {\n providerCooldownUntil.delete(provider);\n}\n\n// ─── Legacy backoff constant (kept for the existing callWithBackoff signature) ─\nconst BASE_BACKOFF_MS = 250;\n\ninterface ProviderError {\n provider: LLMProvider;\n status: number;\n retryable: boolean;\n message: string;\n}\n\n/**\n * Returns `true` for status codes that should trigger a retry.\n * Only 429 and 5xx (transient server errors) qualify; other 4xx are terminal.\n */\nfunction isRetryableForBackoff(status: number): boolean {\n return status === 429 || (status >= 500 && status < 600);\n}\n\nfunction estimateTokens(messages: LLMMessage[], system?: string): number {\n // Cheap estimator: ~4 chars/token. Good enough for threshold routing.\n let chars = system?.length ?? 0;\n for (const m of messages) chars += m.content.length;\n return Math.ceil(chars / 4);\n}\n\nfunction sleep(ms: number, signal?: AbortSignal): Promise<void> {\n return new Promise((resolve, reject) => {\n const t = setTimeout(resolve, ms);\n if (signal) {\n const onAbort = () => {\n clearTimeout(t);\n reject(new DOMException('Aborted', 'AbortError'));\n };\n if (signal.aborted) onAbort();\n else signal.addEventListener('abort', onAbort, { once: true });\n }\n });\n}\n\n/**\n * Computes the exponential backoff delay for a given attempt with jitter.\n *\n * Formula: `Math.min(base * 2^attempt + jitter, cap)`\n * where `jitter` is a random value in `[0, BACKOFF_JITTER_MAX_MS)`.\n *\n * @param attempt - Zero-based attempt index (0 = first retry after initial failure).\n */\nfunction computeBackoffMs(attempt: number): number {\n const jitter = Math.floor(Math.random() * BACKOFF_JITTER_MAX_MS);\n return Math.min(BACKOFF_BASE_MS * Math.pow(2, attempt) + jitter, BACKOFF_CAP_MS);\n}\n\n// ─── Provider request builders ─────────────────────────────────────────────\n\nfunction buildAnthropicRequest(\n model: string,\n messages: LLMMessage[],\n opts: LLMOptions,\n env: LLMEnv,\n streaming = false,\n): { url: string; headers: Record<string, string>; body: string } {\n const sys = opts.system ?? messages.find((m) => m.role === 'system')?.content;\n const filtered = messages.filter((m) => m.role !== 'system');\n const body: Record<string, unknown> = {\n model,\n max_tokens: opts.maxTokens ?? DEFAULT_MAX_TOKENS,\n temperature: opts.temperature ?? DEFAULT_TEMPERATURE,\n messages: filtered.map((m) => ({ role: m.role, content: m.content })),\n };\n if (streaming) {\n body.stream = true;\n }\n if (sys) {\n const cache = opts.promptCache ?? sys.length >= 4096;\n body.system = cache\n ? [{ type: 'text', text: sys, cache_control: { type: 'ephemeral' } }]\n : sys;\n }\n return {\n url: `${env.AI_GATEWAY_BASE_URL}/anthropic/v1/messages`,\n headers: {\n 'content-type': 'application/json',\n 'x-api-key': env.ANTHROPIC_API_KEY,\n 'anthropic-version': '2023-06-01',\n 'anthropic-beta': 'prompt-caching-2024-07-31',\n },\n body: JSON.stringify(body),\n };\n}\n\nfunction buildGeminiRequest(\n model: string,\n messages: LLMMessage[],\n opts: LLMOptions,\n env: LLMEnv,\n): { url: string; headers: Record<string, string>; body: string } {\n const sys = opts.system ?? messages.find((m) => m.role === 'system')?.content;\n const contents = messages\n .filter((m) => m.role !== 'system')\n .map((m) => ({\n role: m.role === 'assistant' ? 'model' : 'user',\n parts: [{ text: m.content }],\n }));\n const body: Record<string, unknown> = {\n contents,\n generationConfig: {\n maxOutputTokens: opts.maxTokens ?? DEFAULT_MAX_TOKENS,\n temperature: opts.temperature ?? DEFAULT_TEMPERATURE,\n },\n };\n if (sys) {\n body.systemInstruction = { parts: [{ text: sys }] };\n }\n const path = `v1/projects/${env.VERTEX_PROJECT}/locations/${env.VERTEX_LOCATION}/publishers/google/models/${model}:generateContent`;\n return {\n url: `${env.AI_GATEWAY_BASE_URL}/google-vertex-ai/${path}`,\n headers: {\n 'content-type': 'application/json',\n authorization: `Bearer ${env.VERTEX_ACCESS_TOKEN}`,\n },\n body: JSON.stringify(body),\n };\n}\n\nfunction buildGroqRequest(\n model: string,\n messages: LLMMessage[],\n opts: LLMOptions,\n env: LLMEnv,\n): { url: string; headers: Record<string, string>; body: string } {\n const sys = opts.system ?? messages.find((m) => m.role === 'system')?.content;\n const merged: LLMMessage[] = [];\n if (sys) merged.push({ role: 'system', content: sys });\n for (const m of messages) if (m.role !== 'system') merged.push(m);\n return {\n url: `${env.AI_GATEWAY_BASE_URL}/groq/openai/v1/chat/completions`,\n headers: {\n 'content-type': 'application/json',\n authorization: `Bearer ${env.GROQ_API_KEY}`,\n },\n body: JSON.stringify({\n model,\n max_tokens: opts.maxTokens ?? DEFAULT_MAX_TOKENS,\n temperature: opts.temperature ?? DEFAULT_TEMPERATURE,\n messages: merged,\n }),\n };\n}\n\nfunction buildGrokRequest(\n model: string,\n messages: LLMMessage[],\n opts: LLMOptions,\n env: LLMEnv,\n): { url: string; headers: Record<string, string>; body: string } {\n if (!env.GROK_API_KEY) {\n throw new ValidationError('GROK_API_KEY required for grok-* model override');\n }\n const sys = opts.system ?? messages.find((m) => m.role === 'system')?.content;\n const merged: LLMMessage[] = [];\n if (sys) merged.push({ role: 'system', content: sys });\n for (const m of messages) if (m.role !== 'system') merged.push(m);\n return {\n url: `${env.AI_GATEWAY_BASE_URL}/grok/v1/chat/completions`,\n headers: {\n 'content-type': 'application/json',\n authorization: `Bearer ${env.GROK_API_KEY}`,\n },\n body: JSON.stringify({\n model,\n max_tokens: opts.maxTokens ?? DEFAULT_MAX_TOKENS,\n temperature: opts.temperature ?? DEFAULT_TEMPERATURE,\n messages: merged,\n }),\n };\n}\n\n// ─── Response parsers ──────────────────────────────────────────────────────\n\ninterface AnthropicResponse {\n content?: Array<{ type: string; text?: string }>;\n usage?: {\n input_tokens?: number;\n output_tokens?: number;\n cache_read_input_tokens?: number;\n cache_creation_input_tokens?: number;\n };\n model?: string;\n}\n\ninterface GeminiResponse {\n candidates?: Array<{ content?: { parts?: Array<{ text?: string }> } }>;\n usageMetadata?: {\n promptTokenCount?: number;\n candidatesTokenCount?: number;\n };\n}\n\ninterface GroqResponse {\n choices?: Array<{ message?: { content?: string } }>;\n usage?: { prompt_tokens?: number; completion_tokens?: number };\n model?: string;\n}\n\nfunction parseAnthropic(\n json: unknown,\n): { content: string; input: number; output: number; cacheRead: number; cacheWrite: number; model?: string } {\n const r = json as AnthropicResponse;\n return {\n content: r.content?.find((c) => c.type === 'text')?.text ?? '',\n input: r.usage?.input_tokens ?? 0,\n output: r.usage?.output_tokens ?? 0,\n cacheRead: r.usage?.cache_read_input_tokens ?? 0,\n cacheWrite: r.usage?.cache_creation_input_tokens ?? 0,\n model: r.model,\n };\n}\n\nfunction parseGemini(json: unknown): { content: string; input: number; output: number } {\n const r = json as GeminiResponse;\n const text =\n r.candidates?.[0]?.content?.parts?.map((p) => p.text ?? '').join('') ?? '';\n return {\n content: text,\n input: r.usageMetadata?.promptTokenCount ?? 0,\n output: r.usageMetadata?.candidatesTokenCount ?? 0,\n };\n}\n\nfunction parseGroq(json: unknown): { content: string; input: number; output: number; model?: string } {\n const r = json as GroqResponse;\n return {\n content: r.choices?.[0]?.message?.content ?? '',\n input: r.usage?.prompt_tokens ?? 0,\n output: r.usage?.completion_tokens ?? 0,\n model: r.model,\n };\n}\n\n// ─── Core call with backoff ────────────────────────────────────────────────\n\n/**\n * Calls a provider with per-provider exponential backoff.\n *\n * Retries up to {@link PER_PROVIDER_MAX_ATTEMPTS} times on 429 or transient 5xx.\n * Other 4xx codes are treated as terminal and not retried.\n * AbortError is never retried — it bubbles immediately.\n *\n * @param provider - Provider name, used for error tagging.\n * @param request - Pre-built HTTP request descriptor.\n * @param fetchImpl - Fetch implementation (injectable for tests).\n * @param signal - Optional AbortSignal for cancellation.\n * @param logger - Optional logger for per-attempt warnings.\n * @param nowFn - Optional clock injection for testability.\n * @returns Parsed JSON body, optional AI Gateway request ID, and attempt count.\n */\nasync function callWithBackoff(\n provider: LLMProvider,\n request: { url: string; headers: Record<string, string>; body: string },\n fetchImpl: typeof fetch,\n signal: AbortSignal | undefined,\n logger: Logger | undefined,\n nowFn?: () => number,\n): Promise<{ json: unknown; gatewayRequestId?: string; attempts: number }> {\n /**\n * Helper: mark provider cooling down and then throw the error.\n * Called whenever we determine we've exhausted all retries for the provider.\n * AbortError is never counted as a provider exhaustion — it bypasses this.\n */\n function exhaustAndThrow(err: ProviderError): never {\n markProviderCoolingDown(provider, nowFn ?? Date.now);\n throw err;\n }\n\n let lastErr: ProviderError | undefined;\n for (let attempt = 1; attempt <= PER_PROVIDER_MAX_ATTEMPTS; attempt++) {\n try {\n const response = await fetchImpl(request.url, {\n method: 'POST',\n headers: request.headers,\n body: request.body,\n signal,\n });\n if (!response.ok) {\n const text = await response.text().catch(() => '');\n const retryable = isRetryableForBackoff(response.status);\n const err: ProviderError = {\n provider,\n status: response.status,\n retryable,\n message: `${provider} ${String(response.status)}: ${text.slice(0, 300)}`,\n };\n logger?.warn?.('llm.provider.error', { provider, status: response.status, attempt });\n if (!err.retryable || attempt === PER_PROVIDER_MAX_ATTEMPTS) {\n if (err.retryable) exhaustAndThrow(err); // retryable but exhausted\n throw err; // terminal non-retryable error — no cooldown\n }\n lastErr = err;\n } else {\n const gatewayRequestId = response.headers.get('cf-aig-request-id') ?? undefined;\n clearProviderCooldown(provider);\n return { json: await response.json(), gatewayRequestId, attempts: attempt };\n }\n } catch (e) {\n if (e instanceof DOMException && e.name === 'AbortError') throw e;\n if (typeof e === 'object' && e !== null && 'retryable' in e) {\n const err = e as ProviderError;\n if (!err.retryable || attempt === PER_PROVIDER_MAX_ATTEMPTS) {\n if (err.retryable) exhaustAndThrow(err); // retryable but exhausted\n throw err; // terminal — no cooldown\n }\n lastErr = err;\n } else {\n const err: ProviderError = {\n provider,\n status: 0,\n retryable: true,\n message: e instanceof Error ? e.message : String(e),\n };\n if (attempt === PER_PROVIDER_MAX_ATTEMPTS) exhaustAndThrow(err);\n lastErr = err;\n }\n }\n // Exponential backoff with jitter: base=500ms, cap=8000ms, jitter up to 250ms\n const backoffMs = computeBackoffMs(attempt - 1);\n await sleep(backoffMs, signal);\n }\n // Fallthrough — should not be reached, but mark cooling down defensively.\n markProviderCoolingDown(provider, nowFn ?? Date.now);\n throw lastErr ?? ({ provider, status: 0, retryable: false, message: 'exhausted' } as ProviderError);\n}\n\nfunction isProviderError(err: unknown): err is ProviderError {\n return (\n typeof err === 'object' &&\n err !== null &&\n typeof (err as { status?: unknown }).status === 'number' &&\n typeof (err as { message?: unknown }).message === 'string' &&\n typeof (err as { provider?: unknown }).provider === 'string'\n );\n}\n\n// ─── Routing ───────────────────────────────────────────────────────────────\n\ninterface RoutePlan {\n primary: { provider: LLMProvider; model: string };\n fallback?: { provider: LLMProvider; model: string };\n}\n\nfunction plan(tier: LLMTier, opts: LLMOptions, tokenEstimate: number): RoutePlan {\n if (opts.model) {\n // Explicit override — best-effort provider detection.\n const m = opts.model;\n if (m.startsWith('claude')) return { primary: { provider: 'anthropic', model: m } };\n if (m.startsWith('gemini')) return { primary: { provider: 'gemini', model: m } };\n if (m.startsWith('grok')) return { primary: { provider: 'grok', model: m } };\n return { primary: { provider: 'groq', model: m } };\n }\n const longContext = tokenEstimate >= (opts.longContextThreshold ?? DEFAULT_LONG_CONTEXT_THRESHOLD);\n switch (tier) {\n case 'verifier':\n return { primary: { provider: 'groq', model: MODELS.groq.verifier } };\n case 'smart':\n return longContext\n ? {\n primary: { provider: 'gemini', model: MODELS.gemini.smart },\n fallback: { provider: 'anthropic', model: MODELS.anthropic.smart },\n }\n : {\n primary: { provider: 'anthropic', model: MODELS.anthropic.smart },\n fallback: { provider: 'gemini', model: MODELS.gemini.smart },\n };\n case 'fast':\n return { primary: { provider: 'anthropic', model: MODELS.anthropic.fast } };\n case 'balanced':\n default:\n return longContext\n ? {\n primary: { provider: 'gemini', model: MODELS.gemini.smart },\n fallback: { provider: 'anthropic', model: MODELS.anthropic.balanced },\n }\n : {\n primary: { provider: 'anthropic', model: MODELS.anthropic.balanced },\n fallback: { provider: 'gemini', model: MODELS.gemini.smart },\n };\n }\n}\n\nasync function callOne(\n leg: { provider: LLMProvider; model: string },\n messages: LLMMessage[],\n opts: LLMOptions,\n env: LLMEnv,\n fetchImpl: typeof fetch,\n logger: Logger | undefined,\n nowFn?: () => number,\n): Promise<{ parsed: { content: string; input: number; output: number; cacheRead?: number; cacheWrite?: number; model?: string }; gatewayRequestId?: string; attempts: number }> {\n let req: { url: string; headers: Record<string, string>; body: string };\n switch (leg.provider) {\n case 'anthropic':\n req = buildAnthropicRequest(leg.model, messages, opts, env);\n break;\n case 'gemini':\n req = buildGeminiRequest(leg.model, messages, opts, env);\n break;\n case 'groq':\n req = buildGroqRequest(leg.model, messages, opts, env);\n break;\n case 'grok':\n req = buildGrokRequest(leg.model, messages, opts, env);\n break;\n }\n const { json, gatewayRequestId, attempts } = await callWithBackoff(\n leg.provider,\n req,\n fetchImpl,\n opts.signal,\n logger,\n nowFn,\n );\n switch (leg.provider) {\n case 'anthropic':\n return { parsed: parseAnthropic(json), gatewayRequestId, attempts };\n case 'gemini':\n return { parsed: parseGemini(json), gatewayRequestId, attempts };\n case 'groq':\n return { parsed: parseGroq(json), gatewayRequestId, attempts };\n case 'grok':\n return { parsed: parseGroq(json), gatewayRequestId, attempts };\n }\n}\n\n/**\n * Run a completion through the routing plan for the requested tier.\n *\n * Routing summary (0.3.0):\n * - `fast` → Anthropic Haiku\n * - `balanced` → Anthropic Sonnet; Gemini 2.5 Pro if `longContextThreshold` exceeded\n * - `smart` → Anthropic Opus; Gemini 2.5 Pro if long-context\n * - `verifier` → Groq Llama 3.3 70B (no fallback — verifier is inherently cheap/best-effort)\n *\n * All provider traffic flows through Cloudflare AI Gateway at `AI_GATEWAY_BASE_URL`.\n *\n * Per-provider reliability guarantees (0.4.0):\n * - Exponential backoff with jitter on 429 / 5xx (base 500ms, cap 8s, up to 2 retries).\n * - Provider cooldown: after exhausting retries the provider is marked cooling down\n * for 30 seconds; subsequent calls skip it and go straight to the fallback leg.\n *\n * @param messages - Ordered chat history.\n * @param env - API key + gateway bindings.\n * @param opts - Optional tier/model/parameters override.\n * @param deps - Optional fetch/logger/clock injection (for testing).\n * @returns A {@link FactoryResponse} carrying either an {@link LLMResult} or\n * an error (`LLM_ALL_PROVIDERS_FAILED`, `LLM_RATE_LIMITED`, or `INTERNAL_ERROR`).\n */\nexport async function complete(\n messages: LLMMessage[],\n env: LLMEnv,\n opts: LLMOptions = {},\n deps: LLMDeps = {},\n): Promise<FactoryResponse<LLMResult>> {\n if (messages.length === 0) {\n throw new ValidationError('messages must not be empty');\n }\n if (!env.AI_GATEWAY_BASE_URL) {\n throw new ValidationError('AI_GATEWAY_BASE_URL is required in 0.3.0');\n }\n const fetchImpl = deps.fetch ?? fetch;\n const now = deps.now ?? (() => Date.now());\n const logger = deps.logger;\n const startedAt = now();\n\n const tier: LLMTier = opts.tier ?? 'balanced';\n const system = opts.system ?? messages.find((m) => m.role === 'system')?.content;\n const tokenEstimate = estimateTokens(messages, system);\n const route = plan(tier, opts, tokenEstimate);\n\n const attemptLog: Array<{ provider: LLMProvider; status?: number; message: string }> = [];\n\n for (const leg of [route.primary, route.fallback].filter(Boolean) as Array<{ provider: LLMProvider; model: string }>) {\n // Skip providers that are currently in their cooldown window.\n if (isProviderCoolingDown(leg.provider, now)) {\n logger?.warn?.('llm.provider.coolingDown', { provider: leg.provider });\n attemptLog.push({ provider: leg.provider, message: 'skipped: cooling down' });\n continue;\n }\n try {\n const result = await callOne(leg, messages, opts, env, fetchImpl, logger, now);\n if (!result.parsed.content) {\n throw { provider: leg.provider, status: 200, retryable: false, message: 'empty content' } satisfies ProviderError;\n }\n logger?.info?.('llm.complete', {\n provider: leg.provider,\n model: leg.model,\n tier,\n tokenEstimate,\n attempts: result.attempts,\n runId: opts.runId,\n project: opts.project,\n actor: opts.actor,\n });\n return {\n data: {\n content: result.parsed.content,\n provider: leg.provider,\n model: result.parsed.model ?? leg.model,\n tier,\n tokens: {\n input: result.parsed.input,\n output: result.parsed.output,\n cacheRead: result.parsed.cacheRead,\n cacheWrite: result.parsed.cacheWrite,\n },\n latency: now() - startedAt,\n attempts: result.attempts,\n gatewayRequestId: result.gatewayRequestId,\n },\n error: null,\n };\n } catch (e) {\n if (e instanceof DOMException && e.name === 'AbortError') {\n return toErrorResponse(\n new InternalError('llm call aborted', { provider: leg.provider, model: leg.model }),\n );\n }\n if (isProviderError(e)) {\n attemptLog.push({ provider: e.provider, status: e.status, message: e.message });\n if (e.status === 429 && !route.fallback) {\n return toErrorResponse(\n new RateLimitError(`llm rate limited on ${e.provider}`, { attempts: attemptLog }),\n );\n }\n logger?.warn?.('llm.leg.failed', { provider: leg.provider, status: e.status });\n continue;\n }\n attemptLog.push({ provider: leg.provider, message: e instanceof Error ? e.message : String(e) });\n }\n }\n\n return toErrorResponse(\n new InternalError('LLM_ALL_PROVIDERS_FAILED', { attempts: attemptLog, tier, tokenEstimate }),\n );\n}\n\n// ─── Streaming ────────────────────────────────────────────────────────────\n\n/**\n * Anthropic server-sent event shapes used by the streaming parser.\n * Only the fields we consume are typed; the rest are ignored.\n */\ninterface AnthropicStreamEvent {\n type: string;\n index?: number;\n delta?: { type?: string; text?: string };\n message?: {\n usage?: {\n input_tokens?: number;\n output_tokens?: number;\n cache_read_input_tokens?: number;\n cache_creation_input_tokens?: number;\n };\n model?: string;\n };\n usage?: {\n input_tokens?: number;\n output_tokens?: number;\n };\n}\n\n/**\n * Streams a completion from the primary Anthropic provider, yielding text chunks\n * as they arrive. Falls back to the non-streaming {@link complete} function when\n * the provider does not support streaming (i.e. a non-Anthropic primary is selected).\n *\n * The generator's **return value** (accessible via `gen.return()` or by consuming\n * the full iteration) is an {@link LLMResult} with the same shape as {@link complete}.\n *\n * Usage pattern:\n * ```ts\n * const gen = completionStream(messages, env, opts);\n * for await (const chunk of gen) {\n * // stream chunk to client\n * }\n * const result = (await gen.return(undefined)).value; // LLMResult\n * ```\n *\n * @param messages - Ordered chat history.\n * @param env - API key + gateway bindings.\n * @param opts - Optional tier/model/parameters override. Accepts `deps` as nested field.\n * @returns An async generator that yields `string` chunks and returns an {@link LLMResult}.\n */\nexport async function* completionStream(\n messages: LLMMessage[],\n env: LLMEnv,\n opts: LLMOptions & { deps?: LLMDeps } = {},\n): AsyncGenerator<string, LLMResult, unknown> {\n if (messages.length === 0) {\n throw new ValidationError('messages must not be empty');\n }\n if (!env.AI_GATEWAY_BASE_URL) {\n throw new ValidationError('AI_GATEWAY_BASE_URL is required in 0.3.0');\n }\n\n const deps: LLMDeps = opts.deps ?? {};\n const fetchImpl = deps.fetch ?? fetch;\n const now = deps.now ?? (() => Date.now());\n const logger = deps.logger;\n const startedAt = now();\n\n const tier: LLMTier = opts.tier ?? 'balanced';\n const system = opts.system ?? messages.find((m) => m.role === 'system')?.content;\n const tokenEstimate = estimateTokens(messages, system);\n const route = plan(tier, opts, tokenEstimate);\n\n // Only Anthropic supports streaming in the current implementation.\n // For all other primaries, fall back to non-streaming complete().\n if (route.primary.provider !== 'anthropic') {\n const result = await complete(messages, env, opts, deps);\n if (result.error !== null || result.data === null) {\n throw new InternalError('LLM_ALL_PROVIDERS_FAILED', { error: result.error });\n }\n yield result.data.content;\n return result.data;\n }\n\n // Check cooldown before attempting the streaming call.\n if (isProviderCoolingDown(route.primary.provider, now)) {\n logger?.warn?.('llm.provider.coolingDown', { provider: route.primary.provider });\n // Fall back to non-streaming complete() which will handle the fallback leg.\n const result = await complete(messages, env, opts, deps);\n if (result.error !== null || result.data === null) {\n throw new InternalError('LLM_ALL_PROVIDERS_FAILED', { error: result.error });\n }\n yield result.data.content;\n return result.data;\n }\n\n const req = buildAnthropicRequest(route.primary.model, messages, opts, env, true);\n\n let response: Response;\n try {\n response = await fetchImpl(req.url, {\n method: 'POST',\n headers: req.headers,\n body: req.body,\n // Fall back to a 60 s default when the caller provides no signal — prevents\n // a hung provider connection from consuming the Worker's wall-clock budget.\n signal: opts.signal ?? AbortSignal.timeout(60_000),\n });\n } catch (e) {\n if (e instanceof DOMException && e.name === 'AbortError') {\n throw new InternalError('llm call aborted', {\n provider: route.primary.provider,\n model: route.primary.model,\n });\n }\n throw new InternalError('llm stream fetch failed', {\n message: e instanceof Error ? e.message : String(e),\n });\n }\n\n if (!response.ok) {\n const text = await response.text().catch(() => '');\n const retryable = isRetryableForBackoff(response.status);\n if (retryable && response.status === 429) {\n markProviderCoolingDown(route.primary.provider, now);\n }\n // Fall back to non-streaming complete() which will try the fallback leg.\n const result = await complete(messages, env, opts, deps);\n if (result.error !== null || result.data === null) {\n throw new InternalError('LLM_ALL_PROVIDERS_FAILED', {\n streamError: `${route.primary.provider} ${String(response.status)}: ${text.slice(0, 300)}`,\n error: result.error,\n });\n }\n yield result.data.content;\n return result.data;\n }\n\n if (!response.body) {\n throw new InternalError('llm stream response body is null', {\n provider: route.primary.provider,\n });\n }\n\n // Stream SSE events from Anthropic.\n const decoder = new TextDecoder();\n let accumulatedText = '';\n let inputTokens = 0;\n let outputTokens = 0;\n let cacheRead = 0;\n let cacheWrite = 0;\n let modelName: string | undefined;\n const gatewayRequestId: string | undefined = response.headers.get('cf-aig-request-id') ?? undefined;\n\n const reader = response.body.getReader();\n let buffer = '';\n\n try {\n while (true) {\n const { done, value } = await reader.read();\n if (done) break;\n buffer += decoder.decode(value, { stream: true });\n\n // SSE lines are delimited by '\\n'. Events are separated by '\\n\\n'.\n const lines = buffer.split('\\n');\n // Keep the last (potentially incomplete) line in the buffer.\n buffer = lines.pop() ?? '';\n\n for (const line of lines) {\n if (!line.startsWith('data: ')) continue;\n const data = line.slice(6).trim();\n if (data === '[DONE]') break;\n let event: AnthropicStreamEvent;\n try {\n event = JSON.parse(data) as AnthropicStreamEvent;\n } catch {\n continue; // Skip malformed SSE lines.\n }\n\n switch (event.type) {\n case 'message_start':\n inputTokens = event.message?.usage?.input_tokens ?? 0;\n cacheRead = event.message?.usage?.cache_read_input_tokens ?? 0;\n cacheWrite = event.message?.usage?.cache_creation_input_tokens ?? 0;\n modelName = event.message?.model;\n break;\n case 'content_block_delta':\n if (event.delta?.type === 'text_delta' && typeof event.delta.text === 'string') {\n accumulatedText += event.delta.text;\n yield event.delta.text;\n }\n break;\n case 'message_delta':\n outputTokens = event.usage?.output_tokens ?? outputTokens;\n break;\n default:\n break;\n }\n }\n }\n } finally {\n reader.releaseLock();\n }\n\n clearProviderCooldown(route.primary.provider);\n logger?.info?.('llm.completionStream', {\n provider: route.primary.provider,\n model: route.primary.model,\n tier,\n tokenEstimate,\n runId: opts.runId,\n project: opts.project,\n actor: opts.actor,\n });\n\n return {\n content: accumulatedText,\n provider: route.primary.provider,\n model: modelName ?? route.primary.model,\n tier,\n tokens: { input: inputTokens, output: outputTokens, cacheRead, cacheWrite },\n latency: now() - startedAt,\n attempts: 1,\n gatewayRequestId,\n };\n}\n\n// ─── Grounding assertion ───────────────────────────────────────────────────\n\n/**\n * Returns `true` if `response` contains at least one verbatim phrase of at\n * least 5 consecutive whitespace-delimited tokens that also appears in one of\n * the `sources` strings.\n *\n * Returns `true` unconditionally when `sources` is empty (no grounding\n * documents means grounding cannot be violated).\n *\n * This is a lightweight guard for RAG pipelines — it detects obvious\n * hallucinations where the model generates content not present in any\n * retrieved source. It is NOT a semantic similarity check.\n *\n * @param response - The LLM-generated text to inspect.\n * @param sources - Retrieved source documents to check against.\n * @returns `true` if the response is grounded, `false` if hallucination detected.\n *\n * @example\n * ```ts\n * const grounded = assertGrounding(llmAnswer, retrievedDocs);\n * if (!grounded) {\n * // flag or re-rank the response\n * }\n * ```\n */\nexport function assertGrounding(response: string, sources: string[]): boolean {\n if (sources.length === 0) return true;\n\n const WINDOW = 5;\n const responseTokens = response.split(/\\s+/).filter((t) => t.length > 0);\n\n if (responseTokens.length < WINDOW) return false;\n\n // Build a set of all 5-token ngrams from each source for O(n) lookup.\n const sourceNgrams = new Set<string>();\n for (const source of sources) {\n const tokens = source.split(/\\s+/).filter((t) => t.length > 0);\n for (let i = 0; i <= tokens.length - WINDOW; i++) {\n const ngram = tokens.slice(i, i + WINDOW).join(' ');\n sourceNgrams.add(ngram);\n }\n }\n\n if (sourceNgrams.size === 0) return false;\n\n // Slide a window of WINDOW tokens over the response and check for a match.\n for (let i = 0; i <= responseTokens.length - WINDOW; i++) {\n const ngram = responseTokens.slice(i, i + WINDOW).join(' ');\n if (sourceNgrams.has(ngram)) return true;\n }\n\n return false;\n}\n\n// ─── Exported helpers (kept for existing consumers) ───────────────────────\n\nexport { MODELS, isProviderCoolingDown, markProviderCoolingDown, clearProviderCooldown, PROVIDER_COOLDOWN_MS };\nexport { BASE_BACKOFF_MS };\n"],"mappings":";AAAA;AAAA,EACE;AAAA,EACA;AAAA,EACA;AAAA,EACA;AAAA,OAEK;AAmGP,IAAM,SAAS;AAAA,EACb,WAAW;AAAA,IACT,MAAM;AAAA,IACN,UAAU;AAAA,IACV,OAAO;AAAA,EACT;AAAA,EACA,QAAQ;AAAA,IACN,OAAO;AAAA,EACT;AAAA,EACA,MAAM;AAAA,IACJ,UAAU;AAAA,EACZ;AAAA,EACA,MAAM;AAAA;AAAA,IAEJ,MAAM;AAAA,IACN,MAAM;AAAA,EACR;AACF;AAEA,IAAM,qBAAqB;AAC3B,IAAM,sBAAsB;AAC5B,IAAM,iCAAiC;AAIvC,IAAM,kBAAkB;AAExB,IAAM,iBAAiB;AAEvB,IAAM,wBAAwB;AAE9B,IAAM,4BAA4B;AAQlC,IAAM,wBAAkD,oBAAI,IAAI;AAGhE,IAAM,uBAAuB;AAM7B,SAAS,sBAAsB,UAAuB,MAAoB,KAAK,KAAc;AAC3F,QAAM,QAAQ,sBAAsB,IAAI,QAAQ;AAChD,MAAI,UAAU,OAAW,QAAO;AAChC,SAAO,IAAI,IAAI;AACjB;AAKA,SAAS,wBAAwB,UAAuB,MAAoB,KAAK,KAAW;AAC1F,wBAAsB,IAAI,UAAU,IAAI,IAAI,oBAAoB;AAClE;AAKA,SAAS,sBAAsB,UAA6B;AAC1D,wBAAsB,OAAO,QAAQ;AACvC;AAGA,IAAM,kBAAkB;AAaxB,SAAS,sBAAsB,QAAyB;AACtD,SAAO,WAAW,OAAQ,UAAU,OAAO,SAAS;AACtD;AAEA,SAAS,eAAe,UAAwB,QAAyB;AAEvE,MAAI,QAAQ,QAAQ,UAAU;AAC9B,aAAW,KAAK,SAAU,UAAS,EAAE,QAAQ;AAC7C,SAAO,KAAK,KAAK,QAAQ,CAAC;AAC5B;AAEA,SAAS,MAAM,IAAY,QAAqC;AAC9D,SAAO,IAAI,QAAQ,CAAC,SAAS,WAAW;AACtC,UAAM,IAAI,WAAW,SAAS,EAAE;AAChC,QAAI,QAAQ;AACV,YAAM,UAAU,MAAM;AACpB,qBAAa,CAAC;AACd,eAAO,IAAI,aAAa,WAAW,YAAY,CAAC;AAAA,MAClD;AACA,UAAI,OAAO,QAAS,SAAQ;AAAA,UACvB,QAAO,iBAAiB,SAAS,SAAS,EAAE,MAAM,KAAK,CAAC;AAAA,IAC/D;AAAA,EACF,CAAC;AACH;AAUA,SAAS,iBAAiB,SAAyB;AACjD,QAAM,SAAS,KAAK,MAAM,KAAK,OAAO,IAAI,qBAAqB;AAC/D,SAAO,KAAK,IAAI,kBAAkB,KAAK,IAAI,GAAG,OAAO,IAAI,QAAQ,cAAc;AACjF;AAIA,SAAS,sBACP,OACA,UACA,MACA,KACA,YAAY,OACoD;AAChE,QAAM,MAAM,KAAK,UAAU,SAAS,KAAK,CAAC,MAAM,EAAE,SAAS,QAAQ,GAAG;AACtE,QAAM,WAAW,SAAS,OAAO,CAAC,MAAM,EAAE,SAAS,QAAQ;AAC3D,QAAM,OAAgC;AAAA,IACpC;AAAA,IACA,YAAY,KAAK,aAAa;AAAA,IAC9B,aAAa,KAAK,eAAe;AAAA,IACjC,UAAU,SAAS,IAAI,CAAC,OAAO,EAAE,MAAM,EAAE,MAAM,SAAS,EAAE,QAAQ,EAAE;AAAA,EACtE;AACA,MAAI,WAAW;AACb,SAAK,SAAS;AAAA,EAChB;AACA,MAAI,KAAK;AACP,UAAM,QAAQ,KAAK,eAAe,IAAI,UAAU;AAChD,SAAK,SAAS,QACV,CAAC,EAAE,MAAM,QAAQ,MAAM,KAAK,eAAe,EAAE,MAAM,YAAY,EAAE,CAAC,IAClE;AAAA,EACN;AACA,SAAO;AAAA,IACL,KAAK,GAAG,IAAI,mBAAmB;AAAA,IAC/B,SAAS;AAAA,MACP,gBAAgB;AAAA,MAChB,aAAa,IAAI;AAAA,MACjB,qBAAqB;AAAA,MACrB,kBAAkB;AAAA,IACpB;AAAA,IACA,MAAM,KAAK,UAAU,IAAI;AAAA,EAC3B;AACF;AAEA,SAAS,mBACP,OACA,UACA,MACA,KACgE;AAChE,QAAM,MAAM,KAAK,UAAU,SAAS,KAAK,CAAC,MAAM,EAAE,SAAS,QAAQ,GAAG;AACtE,QAAM,WAAW,SACd,OAAO,CAAC,MAAM,EAAE,SAAS,QAAQ,EACjC,IAAI,CAAC,OAAO;AAAA,IACX,MAAM,EAAE,SAAS,cAAc,UAAU;AAAA,IACzC,OAAO,CAAC,EAAE,MAAM,EAAE,QAAQ,CAAC;AAAA,EAC7B,EAAE;AACJ,QAAM,OAAgC;AAAA,IACpC;AAAA,IACA,kBAAkB;AAAA,MAChB,iBAAiB,KAAK,aAAa;AAAA,MACnC,aAAa,KAAK,eAAe;AAAA,IACnC;AAAA,EACF;AACA,MAAI,KAAK;AACP,SAAK,oBAAoB,EAAE,OAAO,CAAC,EAAE,MAAM,IAAI,CAAC,EAAE;AAAA,EACpD;AACA,QAAM,OAAO,eAAe,IAAI,cAAc,cAAc,IAAI,eAAe,6BAA6B,KAAK;AACjH,SAAO;AAAA,IACL,KAAK,GAAG,IAAI,mBAAmB,qBAAqB,IAAI;AAAA,IACxD,SAAS;AAAA,MACP,gBAAgB;AAAA,MAChB,eAAe,UAAU,IAAI,mBAAmB;AAAA,IAClD;AAAA,IACA,MAAM,KAAK,UAAU,IAAI;AAAA,EAC3B;AACF;AAEA,SAAS,iBACP,OACA,UACA,MACA,KACgE;AAChE,QAAM,MAAM,KAAK,UAAU,SAAS,KAAK,CAAC,MAAM,EAAE,SAAS,QAAQ,GAAG;AACtE,QAAM,SAAuB,CAAC;AAC9B,MAAI,IAAK,QAAO,KAAK,EAAE,MAAM,UAAU,SAAS,IAAI,CAAC;AACrD,aAAW,KAAK,SAAU,KAAI,EAAE,SAAS,SAAU,QAAO,KAAK,CAAC;AAChE,SAAO;AAAA,IACL,KAAK,GAAG,IAAI,mBAAmB;AAAA,IAC/B,SAAS;AAAA,MACP,gBAAgB;AAAA,MAChB,eAAe,UAAU,IAAI,YAAY;AAAA,IAC3C;AAAA,IACA,MAAM,KAAK,UAAU;AAAA,MACnB;AAAA,MACA,YAAY,KAAK,aAAa;AAAA,MAC9B,aAAa,KAAK,eAAe;AAAA,MACjC,UAAU;AAAA,IACZ,CAAC;AAAA,EACH;AACF;AAEA,SAAS,iBACP,OACA,UACA,MACA,KACgE;AAChE,MAAI,CAAC,IAAI,cAAc;AACrB,UAAM,IAAI,gBAAgB,iDAAiD;AAAA,EAC7E;AACA,QAAM,MAAM,KAAK,UAAU,SAAS,KAAK,CAAC,MAAM,EAAE,SAAS,QAAQ,GAAG;AACtE,QAAM,SAAuB,CAAC;AAC9B,MAAI,IAAK,QAAO,KAAK,EAAE,MAAM,UAAU,SAAS,IAAI,CAAC;AACrD,aAAW,KAAK,SAAU,KAAI,EAAE,SAAS,SAAU,QAAO,KAAK,CAAC;AAChE,SAAO;AAAA,IACL,KAAK,GAAG,IAAI,mBAAmB;AAAA,IAC/B,SAAS;AAAA,MACP,gBAAgB;AAAA,MAChB,eAAe,UAAU,IAAI,YAAY;AAAA,IAC3C;AAAA,IACA,MAAM,KAAK,UAAU;AAAA,MACnB;AAAA,MACA,YAAY,KAAK,aAAa;AAAA,MAC9B,aAAa,KAAK,eAAe;AAAA,MACjC,UAAU;AAAA,IACZ,CAAC;AAAA,EACH;AACF;AA6BA,SAAS,eACP,MAC2G;AAC3G,QAAM,IAAI;AACV,SAAO;AAAA,IACL,SAAS,EAAE,SAAS,KAAK,CAAC,MAAM,EAAE,SAAS,MAAM,GAAG,QAAQ;AAAA,IAC5D,OAAO,EAAE,OAAO,gBAAgB;AAAA,IAChC,QAAQ,EAAE,OAAO,iBAAiB;AAAA,IAClC,WAAW,EAAE,OAAO,2BAA2B;AAAA,IAC/C,YAAY,EAAE,OAAO,+BAA+B;AAAA,IACpD,OAAO,EAAE;AAAA,EACX;AACF;AAEA,SAAS,YAAY,MAAmE;AACtF,QAAM,IAAI;AACV,QAAM,OACJ,EAAE,aAAa,CAAC,GAAG,SAAS,OAAO,IAAI,CAAC,MAAM,EAAE,QAAQ,EAAE,EAAE,KAAK,EAAE,KAAK;AAC1E,SAAO;AAAA,IACL,SAAS;AAAA,IACT,OAAO,EAAE,eAAe,oBAAoB;AAAA,IAC5C,QAAQ,EAAE,eAAe,wBAAwB;AAAA,EACnD;AACF;AAEA,SAAS,UAAU,MAAmF;AACpG,QAAM,IAAI;AACV,SAAO;AAAA,IACL,SAAS,EAAE,UAAU,CAAC,GAAG,SAAS,WAAW;AAAA,IAC7C,OAAO,EAAE,OAAO,iBAAiB;AAAA,IACjC,QAAQ,EAAE,OAAO,qBAAqB;AAAA,IACtC,OAAO,EAAE;AAAA,EACX;AACF;AAmBA,eAAe,gBACb,UACA,SACA,WACA,QACA,QACA,OACyE;AAMzE,WAAS,gBAAgB,KAA2B;AAClD,4BAAwB,UAAU,SAAS,KAAK,GAAG;AACnD,UAAM;AAAA,EACR;AAEA,MAAI;AACJ,WAAS,UAAU,GAAG,WAAW,2BAA2B,WAAW;AACrE,QAAI;AACF,YAAM,WAAW,MAAM,UAAU,QAAQ,KAAK;AAAA,QAC5C,QAAQ;AAAA,QACR,SAAS,QAAQ;AAAA,QACjB,MAAM,QAAQ;AAAA,QACd;AAAA,MACF,CAAC;AACD,UAAI,CAAC,SAAS,IAAI;AAChB,cAAM,OAAO,MAAM,SAAS,KAAK,EAAE,MAAM,MAAM,EAAE;AACjD,cAAM,YAAY,sBAAsB,SAAS,MAAM;AACvD,cAAM,MAAqB;AAAA,UACzB;AAAA,UACA,QAAQ,SAAS;AAAA,UACjB;AAAA,UACA,SAAS,GAAG,QAAQ,IAAI,OAAO,SAAS,MAAM,CAAC,KAAK,KAAK,MAAM,GAAG,GAAG,CAAC;AAAA,QACxE;AACA,gBAAQ,OAAO,sBAAsB,EAAE,UAAU,QAAQ,SAAS,QAAQ,QAAQ,CAAC;AACnF,YAAI,CAAC,IAAI,aAAa,YAAY,2BAA2B;AAC3D,cAAI,IAAI,UAAW,iBAAgB,GAAG;AACtC,gBAAM;AAAA,QACR;AACA,kBAAU;AAAA,MACZ,OAAO;AACL,cAAM,mBAAmB,SAAS,QAAQ,IAAI,mBAAmB,KAAK;AACtE,8BAAsB,QAAQ;AAC9B,eAAO,EAAE,MAAM,MAAM,SAAS,KAAK,GAAG,kBAAkB,UAAU,QAAQ;AAAA,MAC5E;AAAA,IACF,SAAS,GAAG;AACV,UAAI,aAAa,gBAAgB,EAAE,SAAS,aAAc,OAAM;AAChE,UAAI,OAAO,MAAM,YAAY,MAAM,QAAQ,eAAe,GAAG;AAC3D,cAAM,MAAM;AACZ,YAAI,CAAC,IAAI,aAAa,YAAY,2BAA2B;AAC3D,cAAI,IAAI,UAAW,iBAAgB,GAAG;AACtC,gBAAM;AAAA,QACR;AACA,kBAAU;AAAA,MACZ,OAAO;AACL,cAAM,MAAqB;AAAA,UACzB;AAAA,UACA,QAAQ;AAAA,UACR,WAAW;AAAA,UACX,SAAS,aAAa,QAAQ,EAAE,UAAU,OAAO,CAAC;AAAA,QACpD;AACA,YAAI,YAAY,0BAA2B,iBAAgB,GAAG;AAC9D,kBAAU;AAAA,MACZ;AAAA,IACF;AAEA,UAAM,YAAY,iBAAiB,UAAU,CAAC;AAC9C,UAAM,MAAM,WAAW,MAAM;AAAA,EAC/B;AAEA,0BAAwB,UAAU,SAAS,KAAK,GAAG;AACnD,QAAM,WAAY,EAAE,UAAU,QAAQ,GAAG,WAAW,OAAO,SAAS,YAAY;AAClF;AAEA,SAAS,gBAAgB,KAAoC;AAC3D,SACE,OAAO,QAAQ,YACf,QAAQ,QACR,OAAQ,IAA6B,WAAW,YAChD,OAAQ,IAA8B,YAAY,YAClD,OAAQ,IAA+B,aAAa;AAExD;AASA,SAAS,KAAK,MAAe,MAAkB,eAAkC;AAC/E,MAAI,KAAK,OAAO;AAEd,UAAM,IAAI,KAAK;AACf,QAAI,EAAE,WAAW,QAAQ,EAAG,QAAO,EAAE,SAAS,EAAE,UAAU,aAAa,OAAO,EAAE,EAAE;AAClF,QAAI,EAAE,WAAW,QAAQ,EAAG,QAAO,EAAE,SAAS,EAAE,UAAU,UAAU,OAAO,EAAE,EAAE;AAC/E,QAAI,EAAE,WAAW,MAAM,EAAG,QAAO,EAAE,SAAS,EAAE,UAAU,QAAQ,OAAO,EAAE,EAAE;AAC3E,WAAO,EAAE,SAAS,EAAE,UAAU,QAAQ,OAAO,EAAE,EAAE;AAAA,EACnD;AACA,QAAM,cAAc,kBAAkB,KAAK,wBAAwB;AACnE,UAAQ,MAAM;AAAA,IACZ,KAAK;AACH,aAAO,EAAE,SAAS,EAAE,UAAU,QAAQ,OAAO,OAAO,KAAK,SAAS,EAAE;AAAA,IACtE,KAAK;AACH,aAAO,cACH;AAAA,QACE,SAAS,EAAE,UAAU,UAAU,OAAO,OAAO,OAAO,MAAM;AAAA,QAC1D,UAAU,EAAE,UAAU,aAAa,OAAO,OAAO,UAAU,MAAM;AAAA,MACnE,IACA;AAAA,QACE,SAAS,EAAE,UAAU,aAAa,OAAO,OAAO,UAAU,MAAM;AAAA,QAChE,UAAU,EAAE,UAAU,UAAU,OAAO,OAAO,OAAO,MAAM;AAAA,MAC7D;AAAA,IACN,KAAK;AACH,aAAO,EAAE,SAAS,EAAE,UAAU,aAAa,OAAO,OAAO,UAAU,KAAK,EAAE;AAAA,IAC5E,KAAK;AAAA,IACL;AACE,aAAO,cACH;AAAA,QACE,SAAS,EAAE,UAAU,UAAU,OAAO,OAAO,OAAO,MAAM;AAAA,QAC1D,UAAU,EAAE,UAAU,aAAa,OAAO,OAAO,UAAU,SAAS;AAAA,MACtE,IACA;AAAA,QACE,SAAS,EAAE,UAAU,aAAa,OAAO,OAAO,UAAU,SAAS;AAAA,QACnE,UAAU,EAAE,UAAU,UAAU,OAAO,OAAO,OAAO,MAAM;AAAA,MAC7D;AAAA,EACR;AACF;AAEA,eAAe,QACb,KACA,UACA,MACA,KACA,WACA,QACA,OAC+K;AAC/K,MAAI;AACJ,UAAQ,IAAI,UAAU;AAAA,IACpB,KAAK;AACH,YAAM,sBAAsB,IAAI,OAAO,UAAU,MAAM,GAAG;AAC1D;AAAA,IACF,KAAK;AACH,YAAM,mBAAmB,IAAI,OAAO,UAAU,MAAM,GAAG;AACvD;AAAA,IACF,KAAK;AACH,YAAM,iBAAiB,IAAI,OAAO,UAAU,MAAM,GAAG;AACrD;AAAA,IACF,KAAK;AACH,YAAM,iBAAiB,IAAI,OAAO,UAAU,MAAM,GAAG;AACrD;AAAA,EACJ;AACA,QAAM,EAAE,MAAM,kBAAkB,SAAS,IAAI,MAAM;AAAA,IACjD,IAAI;AAAA,IACJ;AAAA,IACA;AAAA,IACA,KAAK;AAAA,IACL;AAAA,IACA;AAAA,EACF;AACA,UAAQ,IAAI,UAAU;AAAA,IACpB,KAAK;AACH,aAAO,EAAE,QAAQ,eAAe,IAAI,GAAG,kBAAkB,SAAS;AAAA,IACpE,KAAK;AACH,aAAO,EAAE,QAAQ,YAAY,IAAI,GAAG,kBAAkB,SAAS;AAAA,IACjE,KAAK;AACH,aAAO,EAAE,QAAQ,UAAU,IAAI,GAAG,kBAAkB,SAAS;AAAA,IAC/D,KAAK;AACH,aAAO,EAAE,QAAQ,UAAU,IAAI,GAAG,kBAAkB,SAAS;AAAA,EACjE;AACF;AAyBA,eAAsB,SACpB,UACA,KACA,OAAmB,CAAC,GACpB,OAAgB,CAAC,GACoB;AACrC,MAAI,SAAS,WAAW,GAAG;AACzB,UAAM,IAAI,gBAAgB,4BAA4B;AAAA,EACxD;AACA,MAAI,CAAC,IAAI,qBAAqB;AAC5B,UAAM,IAAI,gBAAgB,0CAA0C;AAAA,EACtE;AACA,QAAM,YAAY,KAAK,SAAS;AAChC,QAAM,MAAM,KAAK,QAAQ,MAAM,KAAK,IAAI;AACxC,QAAM,SAAS,KAAK;AACpB,QAAM,YAAY,IAAI;AAEtB,QAAM,OAAgB,KAAK,QAAQ;AACnC,QAAM,SAAS,KAAK,UAAU,SAAS,KAAK,CAAC,MAAM,EAAE,SAAS,QAAQ,GAAG;AACzE,QAAM,gBAAgB,eAAe,UAAU,MAAM;AACrD,QAAM,QAAQ,KAAK,MAAM,MAAM,aAAa;AAE5C,QAAM,aAAiF,CAAC;AAExF,aAAW,OAAO,CAAC,MAAM,SAAS,MAAM,QAAQ,EAAE,OAAO,OAAO,GAAsD;AAEpH,QAAI,sBAAsB,IAAI,UAAU,GAAG,GAAG;AAC5C,cAAQ,OAAO,4BAA4B,EAAE,UAAU,IAAI,SAAS,CAAC;AACrE,iBAAW,KAAK,EAAE,UAAU,IAAI,UAAU,SAAS,wBAAwB,CAAC;AAC5E;AAAA,IACF;AACA,QAAI;AACF,YAAM,SAAS,MAAM,QAAQ,KAAK,UAAU,MAAM,KAAK,WAAW,QAAQ,GAAG;AAC7E,UAAI,CAAC,OAAO,OAAO,SAAS;AAC1B,cAAM,EAAE,UAAU,IAAI,UAAU,QAAQ,KAAK,WAAW,OAAO,SAAS,gBAAgB;AAAA,MAC1F;AACA,cAAQ,OAAO,gBAAgB;AAAA,QAC7B,UAAU,IAAI;AAAA,QACd,OAAO,IAAI;AAAA,QACX;AAAA,QACA;AAAA,QACA,UAAU,OAAO;AAAA,QACjB,OAAO,KAAK;AAAA,QACZ,SAAS,KAAK;AAAA,QACd,OAAO,KAAK;AAAA,MACd,CAAC;AACD,aAAO;AAAA,QACL,MAAM;AAAA,UACJ,SAAS,OAAO,OAAO;AAAA,UACvB,UAAU,IAAI;AAAA,UACd,OAAO,OAAO,OAAO,SAAS,IAAI;AAAA,UAClC;AAAA,UACA,QAAQ;AAAA,YACN,OAAO,OAAO,OAAO;AAAA,YACrB,QAAQ,OAAO,OAAO;AAAA,YACtB,WAAW,OAAO,OAAO;AAAA,YACzB,YAAY,OAAO,OAAO;AAAA,UAC5B;AAAA,UACA,SAAS,IAAI,IAAI;AAAA,UACjB,UAAU,OAAO;AAAA,UACjB,kBAAkB,OAAO;AAAA,QAC3B;AAAA,QACA,OAAO;AAAA,MACT;AAAA,IACF,SAAS,GAAG;AACV,UAAI,aAAa,gBAAgB,EAAE,SAAS,cAAc;AACxD,eAAO;AAAA,UACL,IAAI,cAAc,oBAAoB,EAAE,UAAU,IAAI,UAAU,OAAO,IAAI,MAAM,CAAC;AAAA,QACpF;AAAA,MACF;AACA,UAAI,gBAAgB,CAAC,GAAG;AACtB,mBAAW,KAAK,EAAE,UAAU,EAAE,UAAU,QAAQ,EAAE,QAAQ,SAAS,EAAE,QAAQ,CAAC;AAC9E,YAAI,EAAE,WAAW,OAAO,CAAC,MAAM,UAAU;AACvC,iBAAO;AAAA,YACL,IAAI,eAAe,uBAAuB,EAAE,QAAQ,IAAI,EAAE,UAAU,WAAW,CAAC;AAAA,UAClF;AAAA,QACF;AACA,gBAAQ,OAAO,kBAAkB,EAAE,UAAU,IAAI,UAAU,QAAQ,EAAE,OAAO,CAAC;AAC7E;AAAA,MACF;AACA,iBAAW,KAAK,EAAE,UAAU,IAAI,UAAU,SAAS,aAAa,QAAQ,EAAE,UAAU,OAAO,CAAC,EAAE,CAAC;AAAA,IACjG;AAAA,EACF;AAEA,SAAO;AAAA,IACL,IAAI,cAAc,4BAA4B,EAAE,UAAU,YAAY,MAAM,cAAc,CAAC;AAAA,EAC7F;AACF;AAiDA,gBAAuB,iBACrB,UACA,KACA,OAAwC,CAAC,GACG;AAC5C,MAAI,SAAS,WAAW,GAAG;AACzB,UAAM,IAAI,gBAAgB,4BAA4B;AAAA,EACxD;AACA,MAAI,CAAC,IAAI,qBAAqB;AAC5B,UAAM,IAAI,gBAAgB,0CAA0C;AAAA,EACtE;AAEA,QAAM,OAAgB,KAAK,QAAQ,CAAC;AACpC,QAAM,YAAY,KAAK,SAAS;AAChC,QAAM,MAAM,KAAK,QAAQ,MAAM,KAAK,IAAI;AACxC,QAAM,SAAS,KAAK;AACpB,QAAM,YAAY,IAAI;AAEtB,QAAM,OAAgB,KAAK,QAAQ;AACnC,QAAM,SAAS,KAAK,UAAU,SAAS,KAAK,CAAC,MAAM,EAAE,SAAS,QAAQ,GAAG;AACzE,QAAM,gBAAgB,eAAe,UAAU,MAAM;AACrD,QAAM,QAAQ,KAAK,MAAM,MAAM,aAAa;AAI5C,MAAI,MAAM,QAAQ,aAAa,aAAa;AAC1C,UAAM,SAAS,MAAM,SAAS,UAAU,KAAK,MAAM,IAAI;AACvD,QAAI,OAAO,UAAU,QAAQ,OAAO,SAAS,MAAM;AACjD,YAAM,IAAI,cAAc,4BAA4B,EAAE,OAAO,OAAO,MAAM,CAAC;AAAA,IAC7E;AACA,UAAM,OAAO,KAAK;AAClB,WAAO,OAAO;AAAA,EAChB;AAGA,MAAI,sBAAsB,MAAM,QAAQ,UAAU,GAAG,GAAG;AACtD,YAAQ,OAAO,4BAA4B,EAAE,UAAU,MAAM,QAAQ,SAAS,CAAC;AAE/E,UAAM,SAAS,MAAM,SAAS,UAAU,KAAK,MAAM,IAAI;AACvD,QAAI,OAAO,UAAU,QAAQ,OAAO,SAAS,MAAM;AACjD,YAAM,IAAI,cAAc,4BAA4B,EAAE,OAAO,OAAO,MAAM,CAAC;AAAA,IAC7E;AACA,UAAM,OAAO,KAAK;AAClB,WAAO,OAAO;AAAA,EAChB;AAEA,QAAM,MAAM,sBAAsB,MAAM,QAAQ,OAAO,UAAU,MAAM,KAAK,IAAI;AAEhF,MAAI;AACJ,MAAI;AACF,eAAW,MAAM,UAAU,IAAI,KAAK;AAAA,MAClC,QAAQ;AAAA,MACR,SAAS,IAAI;AAAA,MACb,MAAM,IAAI;AAAA;AAAA;AAAA,MAGV,QAAQ,KAAK,UAAU,YAAY,QAAQ,GAAM;AAAA,IACnD,CAAC;AAAA,EACH,SAAS,GAAG;AACV,QAAI,aAAa,gBAAgB,EAAE,SAAS,cAAc;AACxD,YAAM,IAAI,cAAc,oBAAoB;AAAA,QAC1C,UAAU,MAAM,QAAQ;AAAA,QACxB,OAAO,MAAM,QAAQ;AAAA,MACvB,CAAC;AAAA,IACH;AACA,UAAM,IAAI,cAAc,2BAA2B;AAAA,MACjD,SAAS,aAAa,QAAQ,EAAE,UAAU,OAAO,CAAC;AAAA,IACpD,CAAC;AAAA,EACH;AAEA,MAAI,CAAC,SAAS,IAAI;AAChB,UAAM,OAAO,MAAM,SAAS,KAAK,EAAE,MAAM,MAAM,EAAE;AACjD,UAAM,YAAY,sBAAsB,SAAS,MAAM;AACvD,QAAI,aAAa,SAAS,WAAW,KAAK;AACxC,8BAAwB,MAAM,QAAQ,UAAU,GAAG;AAAA,IACrD;AAEA,UAAM,SAAS,MAAM,SAAS,UAAU,KAAK,MAAM,IAAI;AACvD,QAAI,OAAO,UAAU,QAAQ,OAAO,SAAS,MAAM;AACjD,YAAM,IAAI,cAAc,4BAA4B;AAAA,QAClD,aAAa,GAAG,MAAM,QAAQ,QAAQ,IAAI,OAAO,SAAS,MAAM,CAAC,KAAK,KAAK,MAAM,GAAG,GAAG,CAAC;AAAA,QACxF,OAAO,OAAO;AAAA,MAChB,CAAC;AAAA,IACH;AACA,UAAM,OAAO,KAAK;AAClB,WAAO,OAAO;AAAA,EAChB;AAEA,MAAI,CAAC,SAAS,MAAM;AAClB,UAAM,IAAI,cAAc,oCAAoC;AAAA,MAC1D,UAAU,MAAM,QAAQ;AAAA,IAC1B,CAAC;AAAA,EACH;AAGA,QAAM,UAAU,IAAI,YAAY;AAChC,MAAI,kBAAkB;AACtB,MAAI,cAAc;AAClB,MAAI,eAAe;AACnB,MAAI,YAAY;AAChB,MAAI,aAAa;AACjB,MAAI;AACJ,QAAM,mBAAuC,SAAS,QAAQ,IAAI,mBAAmB,KAAK;AAE1F,QAAM,SAAS,SAAS,KAAK,UAAU;AACvC,MAAI,SAAS;AAEb,MAAI;AACF,WAAO,MAAM;AACX,YAAM,EAAE,MAAM,MAAM,IAAI,MAAM,OAAO,KAAK;AAC1C,UAAI,KAAM;AACV,gBAAU,QAAQ,OAAO,OAAO,EAAE,QAAQ,KAAK,CAAC;AAGhD,YAAM,QAAQ,OAAO,MAAM,IAAI;AAE/B,eAAS,MAAM,IAAI,KAAK;AAExB,iBAAW,QAAQ,OAAO;AACxB,YAAI,CAAC,KAAK,WAAW,QAAQ,EAAG;AAChC,cAAM,OAAO,KAAK,MAAM,CAAC,EAAE,KAAK;AAChC,YAAI,SAAS,SAAU;AACvB,YAAI;AACJ,YAAI;AACF,kBAAQ,KAAK,MAAM,IAAI;AAAA,QACzB,QAAQ;AACN;AAAA,QACF;AAEA,gBAAQ,MAAM,MAAM;AAAA,UAClB,KAAK;AACH,0BAAc,MAAM,SAAS,OAAO,gBAAgB;AACpD,wBAAY,MAAM,SAAS,OAAO,2BAA2B;AAC7D,yBAAa,MAAM,SAAS,OAAO,+BAA+B;AAClE,wBAAY,MAAM,SAAS;AAC3B;AAAA,UACF,KAAK;AACH,gBAAI,MAAM,OAAO,SAAS,gBAAgB,OAAO,MAAM,MAAM,SAAS,UAAU;AAC9E,iCAAmB,MAAM,MAAM;AAC/B,oBAAM,MAAM,MAAM;AAAA,YACpB;AACA;AAAA,UACF,KAAK;AACH,2BAAe,MAAM,OAAO,iBAAiB;AAC7C;AAAA,UACF;AACE;AAAA,QACJ;AAAA,MACF;AAAA,IACF;AAAA,EACF,UAAE;AACA,WAAO,YAAY;AAAA,EACrB;AAEA,wBAAsB,MAAM,QAAQ,QAAQ;AAC5C,UAAQ,OAAO,wBAAwB;AAAA,IACrC,UAAU,MAAM,QAAQ;AAAA,IACxB,OAAO,MAAM,QAAQ;AAAA,IACrB;AAAA,IACA;AAAA,IACA,OAAO,KAAK;AAAA,IACZ,SAAS,KAAK;AAAA,IACd,OAAO,KAAK;AAAA,EACd,CAAC;AAED,SAAO;AAAA,IACL,SAAS;AAAA,IACT,UAAU,MAAM,QAAQ;AAAA,IACxB,OAAO,aAAa,MAAM,QAAQ;AAAA,IAClC;AAAA,IACA,QAAQ,EAAE,OAAO,aAAa,QAAQ,cAAc,WAAW,WAAW;AAAA,IAC1E,SAAS,IAAI,IAAI;AAAA,IACjB,UAAU;AAAA,IACV;AAAA,EACF;AACF;AA4BO,SAAS,gBAAgB,UAAkB,SAA4B;AAC5E,MAAI,QAAQ,WAAW,EAAG,QAAO;AAEjC,QAAM,SAAS;AACf,QAAM,iBAAiB,SAAS,MAAM,KAAK,EAAE,OAAO,CAAC,MAAM,EAAE,SAAS,CAAC;AAEvE,MAAI,eAAe,SAAS,OAAQ,QAAO;AAG3C,QAAM,eAAe,oBAAI,IAAY;AACrC,aAAW,UAAU,SAAS;AAC5B,UAAM,SAAS,OAAO,MAAM,KAAK,EAAE,OAAO,CAAC,MAAM,EAAE,SAAS,CAAC;AAC7D,aAAS,IAAI,GAAG,KAAK,OAAO,SAAS,QAAQ,KAAK;AAChD,YAAM,QAAQ,OAAO,MAAM,GAAG,IAAI,MAAM,EAAE,KAAK,GAAG;AAClD,mBAAa,IAAI,KAAK;AAAA,IACxB;AAAA,EACF;AAEA,MAAI,aAAa,SAAS,EAAG,QAAO;AAGpC,WAAS,IAAI,GAAG,KAAK,eAAe,SAAS,QAAQ,KAAK;AACxD,UAAM,QAAQ,eAAe,MAAM,GAAG,IAAI,MAAM,EAAE,KAAK,GAAG;AAC1D,QAAI,aAAa,IAAI,KAAK,EAAG,QAAO;AAAA,EACtC;AAEA,SAAO;AACT;","names":[]}