@inbrowser/model 0.1.0

package/AGENTS.md

@@ -0,0 +1,50 @@
+# Agent context for `@inbrowser/model`
+
+## Purpose
+
+On-device LLM inference. Wraps `@huggingface/transformers` behind a
+narrow `Engine` surface so a local Gemma 4 model is a drop-in
+replacement for a cloud provider when consumed through the adapter
+subpaths.
+
+## Layering invariants
+
+- `src/types.ts` is the canonical type surface. Every other file in
+  the package imports types from here.
+- `src/engine.ts` is the only module that holds runtime state.
+- `src/adapters/relay.ts` is the only place that imports from
+  `@inbrowser/relay`. `src/adapters/agent.ts` is the only place that
+  imports from `@inbrowser/agent`. The root barrel must not.
+- `src/worker.ts` returns the same `Engine` shape `createEngine`
+  returns. Consumers must not need to know which side of `postMessage`
+  the engine lives on.
+
+## Vocabulary
+
+Use the precise terms — they show up in types, comments, and PRs:
+
+- **ModelRef** (locator) vs **ModelPreset** (locator + static config)
+  vs **Engine** (loaded runtime).
+- **Backend**: WebGPU / WASM, the ORT execution provider. Not "GPU
+  mode."
+- **`dtype`**: precision selection. Not "model size."
+- **Cold start** = fetch + init + warmup. Three distinct phases,
+  each with its own `LoadProgress` variant.
+
+## Don't
+
+- Don't add `createGemmaEngine` / `createPhi3Engine` / sugar
+  factories. New models are new `ModelPreset` entries.
+- Don't put tool-calling polyfill logic here. It belongs in
+  `@inbrowser/agent` — it's a property of the agent runtime, not the
+  model.
+- Don't widen `EngineEvent` with cloud-only concepts (cost,
+  thoughtSignature). Translate at the adapter boundary.
+- Don't make `@huggingface/transformers` a regular dependency. It's
+  a peer dep; consumers control the version.
+
+## Status
+
+POC. Types + adapter surface + worker frames are stable. The
+`@huggingface/transformers` wiring inside `createEngine` is the
+next slice.

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 David East
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,63 @@
+# @inbrowser/model
+
+On-device LLM engine. Loads ONNX models in the browser via
+`@huggingface/transformers` + ONNX Runtime Web (WebGPU / WASM), and
+exposes them behind a narrow `Engine` surface.
+
+> **Status: POC stub.** Types, presets, adapter surface, and worker
+> RPC frames are in place. The `@huggingface/transformers` wiring
+> inside `createEngine` is not yet implemented — `generate()` yields
+> an `error` event today. See `src/engine.ts`.
+
+## One-liner
+
+```ts
+import { createEngine } from '@inbrowser/model';
+import { gemma4_E2B } from '@inbrowser/model/presets';
+
+const engine = createEngine(gemma4_E2B);
+await engine.ensureReady();
+
+for await (const evt of engine.generate([
+  { role: 'user', text: 'Explain WebGPU in one paragraph.' },
+])) {
+  if (evt.kind === 'token') process.stdout.write(evt.text);
+}
+```
+
+## Surface
+
+| Export | What it gives you |
+|---|---|
+| `createEngine(preset)` | Runtime `Engine` — owns load state + decode loop |
+| `definePreset(p)` | Type-safe identity helper for community presets |
+| `ModelPreset`, `Engine`, `EngineEvent`, … | Public types |
+| `@inbrowser/model/presets` | `gemma4_E2B`, `gemma4_E4B` |
+| `@inbrowser/model/relay` | `createLocalInferenceProvider(engine)` → relay `InferenceProvider` |
+| `@inbrowser/model/agent` | `createLocalLlmClient(engine, id)` → agent `LlmClient` |
+| `@inbrowser/model/worker` | `hostEngineInWorker(self)` + `connectWorkerEngine(opts)` |
+
+## Vocabulary anchor
+
+- **ONNX** — model file format. **ONNX Runtime Web** is the execution
+  engine (`onnxruntime-web`); WebGPU and WASM are its **backends**.
+- **`dtype`** — weight/activation precision selection (`q4f16`, `q8`,
+  `fp16`, `fp32`). Distinct from parameter count.
+- **`ModelRef`** — bare locator (HF Hub `modelId` + `revision`).
+- **`ModelPreset`** — locator + dtype + backend + capabilities. Static.
+- **`Engine`** — runtime object owning a loaded model. Dynamic.
+- **Cold start** — fetch + init + warmup. **Warm decode** — subsequent
+  calls on a ready engine.
+
+## Design notes
+
+- One factory (`createEngine`), many presets. No `createGemmaEngine`.
+- `capabilities` is on the preset, not the engine — interrogable
+  pre-load (`gemma4_E2B.capabilities.contextWindow`).
+- `EngineEvent` is narrower than `InferenceEvent`/`ChatEvent`.
+  Adapters widen.
+- Worker subpath returns the same `Engine` shape; the agent runtime
+  cannot tell whether it holds a direct or remote engine.
+- Tool calling is not native to Gemma 4. The polyfill (prompt-engineered
+  tool calling + structured-output parsing) lives in `@inbrowser/agent`,
+  not here.

package/dist/adapters/agent.d.ts

@@ -0,0 +1,19 @@
+/**
+ * Adapt an on-device `Engine` to `@inbrowser/agent`'s `LlmClient`.
+ * The agent runtime then drives a local model identically to a
+ * cloud provider — same `chat(req, signal) → AsyncIterable<ChatEvent>`
+ * surface.
+ *
+ * Tool calling: when `req.toolUseEnabled` is true and the engine
+ * doesn't natively support tools, the adapter declines (yields a
+ * single `error` event). The runtime can layer a tool-use polyfill
+ * (`withToolUsePolyfill`) over this client to lift it into a
+ * tool-capable one via prompt-engineered tool calling.
+ *
+ * `@inbrowser/agent` is a peer dep; this subpath is the only point
+ * in `@inbrowser/model` that imports from it.
+ */
+import type { LlmClient } from '@inbrowser/agent';
+import type { Engine } from '../types.js';
+export declare function createLocalLlmClient(engine: Engine, id: string): LlmClient;
+//# sourceMappingURL=agent.d.ts.map

package/dist/adapters/agent.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"agent.d.ts","sourceRoot":"","sources":["../../src/adapters/agent.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;GAcG;AAEH,OAAO,KAAK,EAA0B,SAAS,EAAqB,MAAM,kBAAkB,CAAC;AAC7F,OAAO,KAAK,EAAE,MAAM,EAAiB,MAAM,aAAa,CAAC;AAEzD,wBAAgB,oBAAoB,CAAC,MAAM,EAAE,MAAM,EAAE,EAAE,EAAE,MAAM,GAAG,SAAS,CAQ1E"}

package/dist/adapters/agent.js

@@ -0,0 +1,96 @@
+/**
+ * Adapt an on-device `Engine` to `@inbrowser/agent`'s `LlmClient`.
+ * The agent runtime then drives a local model identically to a
+ * cloud provider — same `chat(req, signal) → AsyncIterable<ChatEvent>`
+ * surface.
+ *
+ * Tool calling: when `req.toolUseEnabled` is true and the engine
+ * doesn't natively support tools, the adapter declines (yields a
+ * single `error` event). The runtime can layer a tool-use polyfill
+ * (`withToolUsePolyfill`) over this client to lift it into a
+ * tool-capable one via prompt-engineered tool calling.
+ *
+ * `@inbrowser/agent` is a peer dep; this subpath is the only point
+ * in `@inbrowser/model` that imports from it.
+ */
+export function createLocalLlmClient(engine, id) {
+    return {
+        id,
+        supportsTools: engine.capabilities.supportsTools,
+        chat(req, signal) {
+            return drive(engine, req, signal);
+        },
+    };
+}
+async function* drive(engine, req, signal) {
+    if (req.toolUseEnabled && !engine.capabilities.supportsTools) {
+        yield {
+            kind: 'error',
+            message: 'engine does not natively support tools — pick a tools-capable preset (see capabilities.supportsTools)',
+        };
+        return;
+    }
+    const messages = toEngineMessages(req.messages);
+    let promptTokens = 0;
+    let completionTokens = 0;
+    // Forward `req.tools` only when the request opts into tool use.
+    // The engine itself gates on `capabilities.supportsTools`; passing
+    // tools to a non-tools-capable engine is a no-op.
+    const tools = req.toolUseEnabled && req.tools.length > 0
+        ? req.tools.map((t) => ({
+            type: 'function',
+            function: { name: t.name, description: t.description, parameters: t.parameters },
+        }))
+        : undefined;
+    for await (const evt of engine.generate(messages, { signal, ...(tools ? { tools } : {}) })) {
+        if (evt.kind === 'token') {
+            yield { kind: 'text', chunk: evt.text };
+            continue;
+        }
+        if (evt.kind === 'thinking') {
+            // ChatEvent has its own 'thinking' kind — pass through. The
+            // engine only emits this when the caller wrapped with
+            // splitThinking() upstream.
+            yield { kind: 'thinking', chunk: evt.text };
+            continue;
+        }
+        if (evt.kind === 'tool_call') {
+            yield {
+                kind: 'tool_call',
+                id: evt.id,
+                name: evt.name,
+                args: evt.args,
+            };
+            continue;
+        }
+        if (evt.kind === 'usage') {
+            promptTokens = evt.promptTokens;
+            completionTokens = evt.outputTokens;
+            continue;
+        }
+        yield { kind: 'error', message: evt.message };
+        return;
+    }
+    yield {
+        kind: 'turn_complete',
+        usage: { promptTokens, completionTokens },
+        details: { requestedModel: engine.model.modelId },
+    };
+}
+function toEngineMessages(messages) {
+    const out = [];
+    for (const m of messages) {
+        if (m.role === 'tool') {
+            out.push({
+                role: 'user',
+                text: `[tool ${m.name ?? ''} result]\n${m.resultJson ?? ''}`,
+            });
+            continue;
+        }
+        if (m.role === 'system' || m.role === 'user' || m.role === 'assistant') {
+            out.push({ role: m.role, text: m.text });
+        }
+    }
+    return out;
+}
+//# sourceMappingURL=agent.js.map

package/dist/adapters/agent.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"agent.js","sourceRoot":"","sources":["../../src/adapters/agent.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;GAcG;AAKH,MAAM,UAAU,oBAAoB,CAAC,MAAc,EAAE,EAAU;IAC7D,OAAO;QACL,EAAE;QACF,aAAa,EAAE,MAAM,CAAC,YAAY,CAAC,aAAa;QAChD,IAAI,CAAC,GAAgB,EAAE,MAAmB;YACxC,OAAO,KAAK,CAAC,MAAM,EAAE,GAAG,EAAE,MAAM,CAAC,CAAC;QACpC,CAAC;KACF,CAAC;AACJ,CAAC;AAED,KAAK,SAAS,CAAC,CAAC,KAAK,CACnB,MAAc,EACd,GAAgB,EAChB,MAAmB;IAEnB,IAAI,GAAG,CAAC,cAAc,IAAI,CAAC,MAAM,CAAC,YAAY,CAAC,aAAa,EAAE,CAAC;QAC7D,MAAM;YACJ,IAAI,EAAE,OAAO;YACb,OAAO,EACL,uGAAuG;SAC1G,CAAC;QACF,OAAO;IACT,CAAC;IAED,MAAM,QAAQ,GAAG,gBAAgB,CAAC,GAAG,CAAC,QAAQ,CAAC,CAAC;IAChD,IAAI,YAAY,GAAG,CAAC,CAAC;IACrB,IAAI,gBAAgB,GAAG,CAAC,CAAC;IAEzB,gEAAgE;IAChE,mEAAmE;IACnE,kDAAkD;IAClD,MAAM,KAAK,GACT,GAAG,CAAC,cAAc,IAAI,GAAG,CAAC,KAAK,CAAC,MAAM,GAAG,CAAC;QACxC,CAAC,CAAC,GAAG,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;YACpB,IAAI,EAAE,UAAmB;YACzB,QAAQ,EAAE,EAAE,IAAI,EAAE,CAAC,CAAC,IAAI,EAAE,WAAW,EAAE,CAAC,CAAC,WAAW,EAAE,UAAU,EAAE,CAAC,CAAC,UAAU,EAAE;SACjF,CAAC,CAAC;QACL,CAAC,CAAC,SAAS,CAAC;IAEhB,IAAI,KAAK,EAAE,MAAM,GAAG,IAAI,MAAM,CAAC,QAAQ,CAAC,QAAQ,EAAE,EAAE,MAAM,EAAE,GAAG,CAAC,KAAK,CAAC,CAAC,CAAC,EAAE,KAAK,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,CAAC,EAAE,CAAC;QAC3F,IAAI,GAAG,CAAC,IAAI,KAAK,OAAO,EAAE,CAAC;YACzB,MAAM,EAAE,IAAI,EAAE,MAAM,EAAE,KAAK,EAAE,GAAG,CAAC,IAAI,EAAE,CAAC;YACxC,SAAS;QACX,CAAC;QACD,IAAI,GAAG,CAAC,IAAI,KAAK,UAAU,EAAE,CAAC;YAC5B,4DAA4D;YAC5D,sDAAsD;YACtD,4BAA4B;YAC5B,MAAM,EAAE,IAAI,EAAE,UAAU,EAAE,KAAK,EAAE,GAAG,CAAC,IAAI,EAAE,CAAC;YAC5C,SAAS;QACX,CAAC;QACD,IAAI,GAAG,CAAC,IAAI,KAAK,WAAW,EAAE,CAAC;YAC7B,MAAM;gBACJ,IAAI,EAAE,WAAW;gBACjB,EAAE,EAAE,GAAG,CAAC,EAAE;gBACV,IAAI,EAAE,GAAG,CAAC,IAAI;gBACd,IAAI,EAAE,GAAG,CAAC,IAAI;aACf,CAAC;YACF,SAAS;QACX,CAAC;QACD,IAAI,GAAG,CAAC,IAAI,KAAK,OAAO,EAAE,CAAC;YACzB,YAAY,GAAG,GAAG,CAAC,YAAY,CAAC;YAChC,gBAAgB,GAAG,GAAG,CAAC,YAAY,CAAC;YACpC,SAAS;QACX,CAAC;QACD,MAAM,EAAE,IAAI,EAAE,OAAO,EAAE,OAAO,EAAE,GAAG,CAAC,OAAO,EAAE,CAAC;QAC9C,OAAO;IACT,CAAC;IAED,MAAM;QACJ,IAAI,EAAE,eAAe;QACrB,KAAK,EAAE,EAAE,YAAY,EAAE,gBAAgB,EAAE;QACzC,OAAO,EAAE,EAAE,cAAc,EAAE,MAAM,CAAC,KAAK,CAAC,OAAO,EAAE;KAClD,CAAC;AACJ,CAAC;AAED,SAAS,gBAAgB,CAAC,QAA0C;IAClE,MAAM,GAAG,GAAoB,EAAE,CAAC;IAChC,KAAK,MAAM,CAAC,IAAI,QAAQ,EAAE,CAAC;QACzB,IAAI,CAAC,CAAC,IAAI,KAAK,MAAM,EAAE,CAAC;YACtB,GAAG,CAAC,IAAI,CAAC;gBACP,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE,SAAS,CAAC,CAAC,IAAI,IAAI,EAAE,aAAa,CAAC,CAAC,UAAU,IAAI,EAAE,EAAE;aAC7D,CAAC,CAAC;YACH,SAAS;QACX,CAAC;QACD,IAAI,CAAC,CAAC,IAAI,KAAK,QAAQ,IAAI,CAAC,CAAC,IAAI,KAAK,MAAM,IAAI,CAAC,CAAC,IAAI,KAAK,WAAW,EAAE,CAAC;YACvE,GAAG,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,CAAC,CAAC,IAAI,EAAE,IAAI,EAAE,CAAC,CAAC,IAAI,EAAE,CAAC,CAAC;QAC3C,CAAC;IACH,CAAC;IACD,OAAO,GAAG,CAAC;AACb,CAAC"}

package/dist/adapters/relay.d.ts

@@ -0,0 +1,17 @@
+/**
+ * Adapt an on-device `Engine` to `@inbrowser/relay`'s
+ * `InferenceProvider`. Lets the relay's existing handlers, durable
+ * storage, and SSE wire format treat a local Gemma model
+ * indistinguishably from Gemini-over-HTTP.
+ *
+ * `NormalizedRequest` fields with no on-device analogue (`apiKey`,
+ * `provider`, `model` routing) are ignored — the engine is already
+ * bound to a single model at construction time.
+ *
+ * `@inbrowser/relay` is a peer dep; this subpath is the only point
+ * in `@inbrowser/model` that imports from it.
+ */
+import type { InferenceProvider } from '@inbrowser/relay';
+import type { Engine } from '../types.js';
+export declare function createLocalInferenceProvider(engine: Engine): InferenceProvider;
+//# sourceMappingURL=relay.d.ts.map

package/dist/adapters/relay.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"relay.d.ts","sourceRoot":"","sources":["../../src/adapters/relay.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;GAYG;AAEH,OAAO,KAAK,EAEV,iBAAiB,EAGlB,MAAM,kBAAkB,CAAC;AAC1B,OAAO,KAAK,EAAE,MAAM,EAAiB,MAAM,aAAa,CAAC;AAEzD,wBAAgB,4BAA4B,CAAC,MAAM,EAAE,MAAM,GAAG,iBAAiB,CA2D9E"}

package/dist/adapters/relay.js

@@ -0,0 +1,90 @@
+/**
+ * Adapt an on-device `Engine` to `@inbrowser/relay`'s
+ * `InferenceProvider`. Lets the relay's existing handlers, durable
+ * storage, and SSE wire format treat a local Gemma model
+ * indistinguishably from Gemini-over-HTTP.
+ *
+ * `NormalizedRequest` fields with no on-device analogue (`apiKey`,
+ * `provider`, `model` routing) are ignored — the engine is already
+ * bound to a single model at construction time.
+ *
+ * `@inbrowser/relay` is a peer dep; this subpath is the only point
+ * in `@inbrowser/model` that imports from it.
+ */
+export function createLocalInferenceProvider(engine) {
+    return async function* (req) {
+        const messages = toEngineMessages(req.messages);
+        const startedAt = performance.now();
+        // Forward declared tools to the engine when the request brings
+        // any. The engine itself gates emission on the preset's
+        // capabilities.supportsTools — passing tools to a non-tools
+        // preset is a no-op rather than an error so callers can be
+        // backend-agnostic about which preset they bound to.
+        const tools = req.tools.length > 0
+            ? req.tools.map((t) => ({
+                type: 'function',
+                function: { name: t.name, description: t.description, parameters: t.parameters },
+            }))
+            : undefined;
+        for await (const evt of engine.generate(messages, {
+            temperature: req.temperature,
+            topP: req.topP,
+            topK: req.topK,
+            ...(tools ? { tools } : {}),
+            ...(req.signal ? { signal: req.signal } : {}),
+        })) {
+            if (evt.kind === 'token') {
+                yield { kind: 'text', chunk: evt.text };
+                continue;
+            }
+            if (evt.kind === 'thinking') {
+                // InferenceEvent has its own 'thinking' kind — pass through.
+                // The engine only emits this when the caller wrapped with
+                // splitThinking() upstream.
+                yield { kind: 'thinking', chunk: evt.text };
+                continue;
+            }
+            if (evt.kind === 'tool_call') {
+                yield {
+                    kind: 'tool_call',
+                    callId: evt.id,
+                    name: evt.name,
+                    args: evt.args,
+                };
+                continue;
+            }
+            if (evt.kind === 'usage') {
+                yield {
+                    kind: 'usage',
+                    promptTokens: evt.promptTokens,
+                    outputTokens: evt.outputTokens,
+                };
+                continue;
+            }
+            yield { kind: 'error', message: evt.message };
+            return;
+        }
+        void startedAt;
+    };
+}
+function toEngineMessages(messages) {
+    const out = [];
+    for (const m of messages) {
+        // The engine vocabulary has no `tool` role — Gemma 4 is toolless.
+        // Tool turns are flattened into the prior assistant message so the
+        // model has the context, but the tool-call/result structure is
+        // dropped. Tool support arrives via the polyfill in @inbrowser/agent.
+        if (m.role === 'tool') {
+            out.push({
+                role: 'user',
+                text: `[tool ${m.name ?? ''} result]\n${m.resultJson ?? ''}`,
+            });
+            continue;
+        }
+        if (m.role === 'system' || m.role === 'user' || m.role === 'assistant') {
+            out.push({ role: m.role, text: m.text ?? '' });
+        }
+    }
+    return out;
+}
+//# sourceMappingURL=relay.js.map

package/dist/adapters/relay.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"relay.js","sourceRoot":"","sources":["../../src/adapters/relay.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;GAYG;AAUH,MAAM,UAAU,4BAA4B,CAAC,MAAc;IACzD,OAAO,KAAK,SAAS,CAAC,EAAE,GAAsB;QAC5C,MAAM,QAAQ,GAAG,gBAAgB,CAAC,GAAG,CAAC,QAAQ,CAAC,CAAC;QAChD,MAAM,SAAS,GAAG,WAAW,CAAC,GAAG,EAAE,CAAC;QAEpC,+DAA+D;QAC/D,wDAAwD;QACxD,4DAA4D;QAC5D,2DAA2D;QAC3D,qDAAqD;QACrD,MAAM,KAAK,GACT,GAAG,CAAC,KAAK,CAAC,MAAM,GAAG,CAAC;YAClB,CAAC,CAAC,GAAG,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;gBACpB,IAAI,EAAE,UAAmB;gBACzB,QAAQ,EAAE,EAAE,IAAI,EAAE,CAAC,CAAC,IAAI,EAAE,WAAW,EAAE,CAAC,CAAC,WAAW,EAAE,UAAU,EAAE,CAAC,CAAC,UAAU,EAAE;aACjF,CAAC,CAAC;YACL,CAAC,CAAC,SAAS,CAAC;QAEhB,IAAI,KAAK,EAAE,MAAM,GAAG,IAAI,MAAM,CAAC,QAAQ,CAAC,QAAQ,EAAE;YAChD,WAAW,EAAE,GAAG,CAAC,WAAW;YAC5B,IAAI,EAAE,GAAG,CAAC,IAAI;YACd,IAAI,EAAE,GAAG,CAAC,IAAI;YACd,GAAG,CAAC,KAAK,CAAC,CAAC,CAAC,EAAE,KAAK,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC;YAC3B,GAAG,CAAC,GAAG,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE,MAAM,EAAE,GAAG,CAAC,MAAM,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC;SAC9C,CAAC,EAAE,CAAC;YACH,IAAI,GAAG,CAAC,IAAI,KAAK,OAAO,EAAE,CAAC;gBACzB,MAAM,EAAE,IAAI,EAAE,MAAM,EAAE,KAAK,EAAE,GAAG,CAAC,IAAI,EAAE,CAAC;gBACxC,SAAS;YACX,CAAC;YACD,IAAI,GAAG,CAAC,IAAI,KAAK,UAAU,EAAE,CAAC;gBAC5B,6DAA6D;gBAC7D,0DAA0D;gBAC1D,4BAA4B;gBAC5B,MAAM,EAAE,IAAI,EAAE,UAAU,EAAE,KAAK,EAAE,GAAG,CAAC,IAAI,EAAE,CAAC;gBAC5C,SAAS;YACX,CAAC;YACD,IAAI,GAAG,CAAC,IAAI,KAAK,WAAW,EAAE,CAAC;gBAC7B,MAAM;oBACJ,IAAI,EAAE,WAAW;oBACjB,MAAM,EAAE,GAAG,CAAC,EAAE;oBACd,IAAI,EAAE,GAAG,CAAC,IAAI;oBACd,IAAI,EAAE,GAAG,CAAC,IAAI;iBACf,CAAC;gBACF,SAAS;YACX,CAAC;YACD,IAAI,GAAG,CAAC,IAAI,KAAK,OAAO,EAAE,CAAC;gBACzB,MAAM;oBACJ,IAAI,EAAE,OAAO;oBACb,YAAY,EAAE,GAAG,CAAC,YAAY;oBAC9B,YAAY,EAAE,GAAG,CAAC,YAAY;iBAC/B,CAAC;gBACF,SAAS;YACX,CAAC;YACD,MAAM,EAAE,IAAI,EAAE,OAAO,EAAE,OAAO,EAAE,GAAG,CAAC,OAAO,EAAE,CAAC;YAC9C,OAAO;QACT,CAAC;QAED,KAAK,SAAS,CAAC;IACjB,CAAC,CAAC;AACJ,CAAC;AAED,SAAS,gBAAgB,CAAC,QAA0C;IAClE,MAAM,GAAG,GAAoB,EAAE,CAAC;IAChC,KAAK,MAAM,CAAC,IAAI,QAAQ,EAAE,CAAC;QACzB,kEAAkE;QAClE,mEAAmE;QACnE,+DAA+D;QAC/D,sEAAsE;QACtE,IAAI,CAAC,CAAC,IAAI,KAAK,MAAM,EAAE,CAAC;YACtB,GAAG,CAAC,IAAI,CAAC;gBACP,IAAI,EAAE,MAAM;gBACZ,IAAI,EAAE,SAAS,CAAC,CAAC,IAAI,IAAI,EAAE,aAAa,CAAC,CAAC,UAAU,IAAI,EAAE,EAAE;aAC7D,CAAC,CAAC;YACH,SAAS;QACX,CAAC;QACD,IAAI,CAAC,CAAC,IAAI,KAAK,QAAQ,IAAI,CAAC,CAAC,IAAI,KAAK,MAAM,IAAI,CAAC,CAAC,IAAI,KAAK,WAAW,EAAE,CAAC;YACvE,GAAG,CAAC,IAAI,CAAC,EAAE,IAAI,EAAE,CAAC,CAAC,IAAI,EAAE,IAAI,EAAE,CAAC,CAAC,IAAI,IAAI,EAAE,EAAE,CAAC,CAAC;QACjD,CAAC;IACH,CAAC;IACD,OAAO,GAAG,CAAC;AACb,CAAC"}

package/dist/engine.d.ts

@@ -0,0 +1,35 @@
+/**
+ * `createEngine` — on-device LLM engine implementation.
+ *
+ * Wires `@huggingface/transformers` v4 to the narrow `Engine` surface
+ * declared in `./types.ts`:
+ *
+ *   - `ensureReady()` loads the `AutoProcessor` + `AutoModelForCausalLM`
+ *     pair from the configured HF Hub repo, mapping the runtime's
+ *     `ProgressInfo` stream into `LoadProgress` events.
+ *   - `generate()` applies the model's bundled chat template, sets up
+ *     a `TextStreamer` whose `callback_function` pushes tokens into
+ *     an async-iterator queue, and drives `model.generate()`. Yields
+ *     `{ kind: 'token' }` per decoded chunk, then a terminal `usage`
+ *     event with the engine's local accounting.
+ *
+ * Backend mapping: `Backend` ('auto' | 'webgpu' | 'wasm') passes
+ * straight through to Transformers.js's `DeviceType`. `dtype` is
+ * forwarded unchanged.
+ *
+ * Tool calling: the engine itself is toolless. The agent-side
+ * polyfill lives in `@inbrowser/agent` (see AGENTS.md).
+ *
+ * Stop sequences: `GenerateOpts.stop` is accepted but not yet
+ * honored — needs a `StoppingCriteria` adapter. Tracked as a
+ * follow-up.
+ */
+import type { CreateEngineOpts, Engine } from './types.js';
+export declare function createEngine(opts: CreateEngineOpts): Engine;
+/**
+ * Type-safe preset authoring. Identity at runtime; the value of this
+ * helper is purely the compile-time completeness check it enforces
+ * on caller-defined presets.
+ */
+export declare function definePreset<P extends import('./types.js').ModelPreset>(p: P): P;
+//# sourceMappingURL=engine.d.ts.map

package/dist/engine.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"engine.d.ts","sourceRoot":"","sources":["../src/engine.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;;;;;;;GAyBG;AAaH,OAAO,KAAK,EAEV,gBAAgB,EAChB,MAAM,EAUP,MAAM,YAAY,CAAC;AAEpB,wBAAgB,YAAY,CAAC,IAAI,EAAE,gBAAgB,GAAG,MAAM,CAqS3D;AAED;;;;GAIG;AACH,wBAAgB,YAAY,CAAC,CAAC,SAAS,OAAO,YAAY,EAAE,WAAW,EAAE,CAAC,EAAE,CAAC,GAAG,CAAC,CAEhF"}