@runanywhere/web 0.1.0-beta.1 → 0.1.0-beta.10

package/README.md

@@ -100,25 +100,36 @@ On-device AI for the browser. Run LLMs, Speech-to-Text, Text-to-Speech, Vision,
 
 ## Package Structure
 
-The Web SDK is a single npm package. Unlike native SDKs (iOS, Android, React Native, Flutter) which use separate packages per backend, the Web SDK compiles all inference backends into a single WebAssembly binary. Backend selection happens at WASM build time, not at the package level.
+The Web SDK is split into three npm packages so you only ship the backends you need:
 
-```
-@runanywhere/web           -- TypeScript API + pre-built WASM (all backends)
-```
+| Package | Description | Includes |
+|---------|-------------|----------|
+| [`@runanywhere/web`](https://www.npmjs.com/package/@runanywhere/web) | Core SDK — lifecycle, logging, events, model management, storage | TypeScript only (no WASM) |
+| [`@runanywhere/web-llamacpp`](https://www.npmjs.com/package/@runanywhere/web-llamacpp) | LLM, VLM, tool calling, structured output, embeddings, diffusion | llama.cpp WASM (~3.7 MB CPU, ~3.9 MB WebGPU) |
+| [`@runanywhere/web-onnx`](https://www.npmjs.com/package/@runanywhere/web-onnx) | STT, TTS, VAD, audio capture/playback | [sherpa-onnx](https://github.com/k2-fsa/sherpa-onnx) WASM (~12 MB, lazy-loaded) |
 
-The pre-built WASM includes llama.cpp (LLM/VLM), whisper.cpp (STT), and sherpa-onnx (TTS/VAD). Developers who need a smaller WASM binary with specific backends can [build from source](#building-from-source) with selective flags.
+Install only what you need — `@runanywhere/web` is always required as the core.
 
 ---
 
 ## Installation
 
 ```bash
-npm install @runanywhere/web
+# Core + all backends
+npm install @runanywhere/web @runanywhere/web-llamacpp @runanywhere/web-onnx
+
+# LLM/VLM only (no speech)
+npm install @runanywhere/web @runanywhere/web-llamacpp
+
+# Speech only (no LLM)
+npm install @runanywhere/web @runanywhere/web-onnx
 ```
 
-### Serve WASM Files
+### Serve WASM Files + Cross-Origin Isolation
 
-The package includes pre-built WASM files in `node_modules/@runanywhere/web/wasm/`. Configure your bundler to serve these as static assets.
+WASM files are included in `@runanywhere/web-llamacpp` and `@runanywhere/web-onnx`. Configure your bundler to serve them as static assets.
+
+> **Important:** Your server **must** set Cross-Origin Isolation headers for `SharedArrayBuffer` and multi-threaded WASM to work. Without these headers the SDK falls back to single-threaded mode, which is significantly slower. See [Cross-Origin Isolation Headers](#cross-origin-isolation-headers) for all platforms (Nginx, Vercel, Netlify, Cloudflare, AWS, Apache).
 
 **Vite:**
 
@@ -132,9 +143,15 @@ export default defineConfig({
       'Cross-Origin-Embedder-Policy': 'credentialless',
     },
   },
+  worker: { format: 'es' },
+  optimizeDeps: {
+    exclude: ['@runanywhere/web-llamacpp', '@runanywhere/web-onnx'],
+  },
 });
 ```
 
+> **Warning (Vite users):** You **must** add `@runanywhere/web-llamacpp` and `@runanywhere/web-onnx` to `optimizeDeps.exclude`. Vite's dependency pre-bundling flattens packages into `.vite/deps/`, which breaks the relative `import.meta.url` paths the SDK uses to locate its WASM files. Without this exclusion, WASM loading will fail with a "Failed to fetch dynamically imported module" error. This is a known Vite limitation with npm packages that resolve static assets via `import.meta.url`.
+
 **Webpack:**
 
 ```javascript
@@ -145,9 +162,17 @@ module.exports = {
       { test: /\.wasm$/, type: 'asset/resource' },
     ],
   },
+  devServer: {
+    headers: {
+      'Cross-Origin-Opener-Policy': 'same-origin',
+      'Cross-Origin-Embedder-Policy': 'credentialless',
+    },
+  },
 };
 ```
 
+> **Safari/iOS:** Safari does not support `credentialless` COEP. Use the COI service worker pattern shown in the [demo app](../../examples/web/RunAnywhereAI/) — it intercepts responses and injects `require-corp` headers at runtime.
+
 ---
 
 ## Quick Start
@@ -156,14 +181,20 @@ module.exports = {
 
 ```typescript
 import { RunAnywhere } from '@runanywhere/web';
+import { LlamaCPP, TextGeneration } from '@runanywhere/web-llamacpp';
+import { ONNX, STT, STTModelType, TTS, VAD, SpeechActivity } from '@runanywhere/web-onnx';
 
 await RunAnywhere.initialize({ environment: 'development', debug: true });
+
+// Register backends
+await LlamaCPP.register();
+await ONNX.register();
 ```
 
 ### 2. Text Generation (LLM)
 
 ```typescript
-import { TextGeneration } from '@runanywhere/web';
+import { TextGeneration } from '@runanywhere/web-llamacpp';
 
 // Load a GGUF model
 await TextGeneration.loadModel('/models/qwen2.5-0.5b-instruct-q4_0.gguf', 'qwen2.5-0.5b');
@@ -181,7 +212,7 @@ for await (const token of TextGeneration.generateStream('Write a haiku about cod
 ### 3. Speech-to-Text (STT)
 
 ```typescript
-import { STT } from '@runanywhere/web';
+import { STT, STTModelType } from '@runanywhere/web-onnx';
 
 await STT.loadModel({
   modelId: 'whisper-tiny',
@@ -197,7 +228,7 @@ console.log(result.text);
 ### 4. Text-to-Speech (TTS)
 
 ```typescript
-import { TTS } from '@runanywhere/web';
+import { TTS } from '@runanywhere/web-onnx';
 
 await TTS.loadVoice({
   voiceId: 'piper-en',
@@ -213,7 +244,7 @@ const result = await TTS.synthesize('Hello from RunAnywhere!');
 ### 5. Voice Activity Detection (VAD)
 
 ```typescript
-import { VAD, SpeechActivity } from '@runanywhere/web';
+import { VAD, SpeechActivity } from '@runanywhere/web-onnx';
 
 await VAD.initialize({ modelPath: '/models/silero_vad.onnx' });
 
@@ -231,7 +262,7 @@ VAD.processSamples(audioChunk);
 ### 6. Vision Language Model (VLM)
 
 ```typescript
-import { VLM, VLMImageFormat } from '@runanywhere/web';
+import { VLM, VLMImageFormat } from '@runanywhere/web-llamacpp';
 
 await VLM.loadModel('/models/qwen2-vl.gguf', '/models/mmproj.gguf', 'qwen2-vl');
 
@@ -650,38 +681,46 @@ The demo app runs on Vite with Cross-Origin Isolation headers pre-configured.
 
 ---
 
-## npm Package
-
-```
-@runanywhere/web
-```
+## npm Packages
 
-### Published Exports
+### `@runanywhere/web` (core)
 
 | Export | Description |
 |--------|-------------|
 | `RunAnywhere` | SDK lifecycle (initialize, shutdown, capabilities) |
+| `ModelManager` | Model download, storage, and loading |
+| `OPFSStorage` | Persistent storage via OPFS |
+| `SDKLogger` | Structured logging |
+| `SDKError` | Typed error hierarchy |
+| `EventBus` | SDK event system |
+| `detectCapabilities` | Browser feature detection |
+
+### `@runanywhere/web-llamacpp`
+
+| Export | Description |
+|--------|-------------|
+| `LlamaCPP` | Backend registration |
 | `TextGeneration` | LLM text generation and streaming |
-| `STT` | Speech-to-text transcription |
-| `TTS` | Text-to-speech synthesis |
-| `VAD` | Voice activity detection |
 | `VLM` | Vision-language model inference |
-| `VoicePipeline` | STT -> LLM -> TTS orchestration |
-| `VoiceAgent` | Complete voice agent with C API pipeline |
-| `ToolCalling` | Function calling with typed tool definitions |
+| `ToolCalling` | Function calling with typed definitions |
 | `StructuredOutput` | JSON schema-guided generation |
 | `Embeddings` | Vector embedding generation |
-| `Diffusion` | Image generation (WebGPU, scaffold) |
+| `Diffusion` | Image generation (WebGPU) |
+| `VLMWorkerBridge` | Web Worker bridge for VLM inference |
+| `VideoCapture` | Camera capture and frame extraction |
+| `TelemetryService` | Telemetry and analytics |
+
+### `@runanywhere/web-onnx`
+
+| Export | Description |
+|--------|-------------|
+| `ONNX` | Backend registration |
+| `STT` | Speech-to-text transcription |
+| `TTS` | Text-to-speech synthesis |
+| `VAD` | Voice activity detection |
 | `AudioCapture` | Microphone capture via Web Audio API |
 | `AudioPlayback` | Audio playback via Web Audio API |
-| `VideoCapture` | Camera capture and frame extraction |
-| `ModelManager` | Advanced model download/storage/loading |
-| `OPFSStorage` | Low-level OPFS persistence |
-| `VLMWorkerBridge` | Web Worker bridge for VLM inference |
-| `SDKLogger` | Structured logging |
-| `SDKError` | Typed error hierarchy |
-| `EventBus` | SDK event system |
-| `detectCapabilities` | Browser feature detection |
+| `AudioFileLoader` | Audio file loading and decoding |
 
 ---
 
@@ -715,6 +754,18 @@ Yes. Any GGUF-format model compatible with llama.cpp works for LLM/VLM. STT mode
 
 ## Troubleshooting
 
+### "Failed to fetch dynamically imported module" / WASM not loading (Vite)
+
+**Cause:** Vite pre-bundles npm dependencies into `.vite/deps/`, which breaks the relative `import.meta.url` paths used by `@runanywhere/web-llamacpp` and `@runanywhere/web-onnx` to locate their WASM files.
+
+**Fix:** Add both packages to `optimizeDeps.exclude` in your `vite.config.ts`:
+
+```typescript
+optimizeDeps: {
+  exclude: ['@runanywhere/web-llamacpp', '@runanywhere/web-onnx'],
+},
+```
+
 ### "SharedArrayBuffer is not defined"
 
 **Cause:** Missing Cross-Origin Isolation headers.

package/dist/Foundation/ErrorTypes.js

@@ -83,8 +83,15 @@ export class SDKError extends Error {
     static modelNotFound(modelId) {
         return new SDKError(SDKErrorCode.ModelNotFound, `Model not found: ${modelId}`);
     }
+    static componentNotReady(component, details) {
+        return new SDKError(SDKErrorCode.ComponentNotReady, `Component not ready: ${component}`, details);
+    }
     static generationFailed(details) {
         return new SDKError(SDKErrorCode.GenerationFailed, 'Generation failed', details);
     }
 }
+/** Type guard: returns true if the value is an SDKError instance. */
+export function isSDKError(error) {
+    return error instanceof SDKError;
+}
 //# sourceMappingURL=ErrorTypes.js.map

package/dist/Foundation/ErrorTypes.js.map

@@ -1 +1 @@
-{"version":3,"file":"ErrorTypes.js","sourceRoot":"","sources":["../../src/Foundation/ErrorTypes.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AAEH,kCAAkC;AAClC,MAAM,CAAN,IAAY,YAsDX;AAtDD,WAAY,YAAY;IACtB,UAAU;IACV,qDAAW,CAAA;IAEX,uCAAuC;IACvC,sEAAqB,CAAA;IACrB,8EAAyB,CAAA;IACzB,kFAA2B,CAAA;IAC3B,kFAA2B,CAAA;IAE3B,8BAA8B;IAC9B,oEAAoB,CAAA;IACpB,wEAAsB,CAAA;IACtB,8EAAyB,CAAA;IACzB,sEAAqB,CAAA;IACrB,8EAAyB,CAAA;IAEzB,mCAAmC;IACnC,0EAAuB,CAAA;IACvB,gFAA0B,CAAA;IAC1B,4EAAwB,CAAA;IACxB,oEAAoB,CAAA;IACpB,oFAA4B,CAAA;IAE5B,gCAAgC;IAChC,kEAAmB,CAAA;IACnB,sEAAqB,CAAA;IACrB,kFAA2B,CAAA;IAC3B,sEAAqB,CAAA;IACrB,4EAAwB,CAAA;IAExB,gCAAgC;IAChC,kEAAmB,CAAA;IACnB,gFAA0B,CAAA;IAC1B,kEAAmB,CAAA;IACnB,wEAAsB,CAAA;IAEtB,kCAAkC;IAClC,0EAAuB,CAAA;IAEvB,kCAAkC;IAClC,4EAAwB,CAAA;IACxB,oEAAoB,CAAA;IACpB,kEAAmB,CAAA;IAEnB,gCAAgC;IAChC,gFAA0B,CAAA;IAC1B,kEAAmB,CAAA;IAEnB,sCAAsC;IACtC,sEAAqB,CAAA;IACrB,oEAAoB,CAAA;IACpB,4EAAwB,CAAA;IACxB,wEAAsB,CAAA;AACxB,CAAC,EAtDW,YAAY,KAAZ,YAAY,QAsDvB;AAED;;GAEG;AACH,MAAM,OAAO,QAAS,SAAQ,KAAK;IACxB,IAAI,CAAe;IACnB,OAAO,CAAU;IAE1B,YAAY,IAAkB,EAAE,OAAe,EAAE,OAAgB;QAC/D,KAAK,CAAC,OAAO,CAAC,CAAC;QACf,IAAI,CAAC,IAAI,GAAG,UAAU,CAAC;QACvB,IAAI,CAAC,IAAI,GAAG,IAAI,CAAC;QACjB,IAAI,CAAC,OAAO,GAAG,OAAO,CAAC;IACzB,CAAC;IAED,sDAAsD;IACtD,MAAM,CAAC,aAAa,CAAC,UAAkB,EAAE,OAAgB;QACvD,MAAM,OAAO,GAAG,oBAAoB,UAAU,EAAE,CAAC;QACjD,OAAO,IAAI,QAAQ,CAAC,UAA0B,EAAE,OAAO,EAAE,OAAO,CAAC,CAAC;IACpE,CAAC;IAED,4CAA4C;IAC5C,MAAM,CAAC,SAAS,CAAC,UAAkB;QACjC,OAAO,UAAU,KAAK,CAAC,CAAC;IAC1B,CAAC;IAED,+BAA+B;IAC/B,MAAM,CAAC,cAAc,CAAC,OAAO,GAAG,qBAAqB;QACnD,OAAO,IAAI,QAAQ,CAAC,YAAY,CAAC,cAAc,EAAE,OAAO,CAAC,CAAC;IAC5D,CAAC;IAED,MAAM,CAAC,aAAa,CAAC,OAAO,GAAG,wBAAwB;QACrD,OAAO,IAAI,QAAQ,CAAC,YAAY,CAAC,aAAa,EAAE,OAAO,CAAC,CAAC;IAC3D,CAAC;IAED,MAAM,CAAC,aAAa,CAAC,OAAe;QAClC,OAAO,IAAI,QAAQ,CACjB,YAAY,CAAC,aAAa,EAC1B,oBAAoB,OAAO,EAAE,CAC9B,CAAC;IACJ,CAAC;IAED,MAAM,CAAC,gBAAgB,CAAC,OAAgB;QACtC,OAAO,IAAI,QAAQ,CACjB,YAAY,CAAC,gBAAgB,EAC7B,mBAAmB,EACnB,OAAO,CACR,CAAC;IACJ,CAAC;CACF"}
+{"version":3,"file":"ErrorTypes.js","sourceRoot":"","sources":["../../src/Foundation/ErrorTypes.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AAEH,kCAAkC;AAClC,MAAM,CAAN,IAAY,YAsDX;AAtDD,WAAY,YAAY;IACtB,UAAU;IACV,qDAAW,CAAA;IAEX,uCAAuC;IACvC,sEAAqB,CAAA;IACrB,8EAAyB,CAAA;IACzB,kFAA2B,CAAA;IAC3B,kFAA2B,CAAA;IAE3B,8BAA8B;IAC9B,oEAAoB,CAAA;IACpB,wEAAsB,CAAA;IACtB,8EAAyB,CAAA;IACzB,sEAAqB,CAAA;IACrB,8EAAyB,CAAA;IAEzB,mCAAmC;IACnC,0EAAuB,CAAA;IACvB,gFAA0B,CAAA;IAC1B,4EAAwB,CAAA;IACxB,oEAAoB,CAAA;IACpB,oFAA4B,CAAA;IAE5B,gCAAgC;IAChC,kEAAmB,CAAA;IACnB,sEAAqB,CAAA;IACrB,kFAA2B,CAAA;IAC3B,sEAAqB,CAAA;IACrB,4EAAwB,CAAA;IAExB,gCAAgC;IAChC,kEAAmB,CAAA;IACnB,gFAA0B,CAAA;IAC1B,kEAAmB,CAAA;IACnB,wEAAsB,CAAA;IAEtB,kCAAkC;IAClC,0EAAuB,CAAA;IAEvB,kCAAkC;IAClC,4EAAwB,CAAA;IACxB,oEAAoB,CAAA;IACpB,kEAAmB,CAAA;IAEnB,gCAAgC;IAChC,gFAA0B,CAAA;IAC1B,kEAAmB,CAAA;IAEnB,sCAAsC;IACtC,sEAAqB,CAAA;IACrB,oEAAoB,CAAA;IACpB,4EAAwB,CAAA;IACxB,wEAAsB,CAAA;AACxB,CAAC,EAtDW,YAAY,KAAZ,YAAY,QAsDvB;AAED;;GAEG;AACH,MAAM,OAAO,QAAS,SAAQ,KAAK;IACxB,IAAI,CAAe;IACnB,OAAO,CAAU;IAE1B,YAAY,IAAkB,EAAE,OAAe,EAAE,OAAgB;QAC/D,KAAK,CAAC,OAAO,CAAC,CAAC;QACf,IAAI,CAAC,IAAI,GAAG,UAAU,CAAC;QACvB,IAAI,CAAC,IAAI,GAAG,IAAI,CAAC;QACjB,IAAI,CAAC,OAAO,GAAG,OAAO,CAAC;IACzB,CAAC;IAED,sDAAsD;IACtD,MAAM,CAAC,aAAa,CAAC,UAAkB,EAAE,OAAgB;QACvD,MAAM,OAAO,GAAG,oBAAoB,UAAU,EAAE,CAAC;QACjD,OAAO,IAAI,QAAQ,CAAC,UAA0B,EAAE,OAAO,EAAE,OAAO,CAAC,CAAC;IACpE,CAAC;IAED,4CAA4C;IAC5C,MAAM,CAAC,SAAS,CAAC,UAAkB;QACjC,OAAO,UAAU,KAAK,CAAC,CAAC;IAC1B,CAAC;IAED,+BAA+B;IAC/B,MAAM,CAAC,cAAc,CAAC,OAAO,GAAG,qBAAqB;QACnD,OAAO,IAAI,QAAQ,CAAC,YAAY,CAAC,cAAc,EAAE,OAAO,CAAC,CAAC;IAC5D,CAAC;IAED,MAAM,CAAC,aAAa,CAAC,OAAO,GAAG,wBAAwB;QACrD,OAAO,IAAI,QAAQ,CAAC,YAAY,CAAC,aAAa,EAAE,OAAO,CAAC,CAAC;IAC3D,CAAC;IAED,MAAM,CAAC,aAAa,CAAC,OAAe;QAClC,OAAO,IAAI,QAAQ,CACjB,YAAY,CAAC,aAAa,EAC1B,oBAAoB,OAAO,EAAE,CAC9B,CAAC;IACJ,CAAC;IAED,MAAM,CAAC,iBAAiB,CAAC,SAAiB,EAAE,OAAgB;QAC1D,OAAO,IAAI,QAAQ,CACjB,YAAY,CAAC,iBAAiB,EAC9B,wBAAwB,SAAS,EAAE,EACnC,OAAO,CACR,CAAC;IACJ,CAAC;IAED,MAAM,CAAC,gBAAgB,CAAC,OAAgB;QACtC,OAAO,IAAI,QAAQ,CACjB,YAAY,CAAC,gBAAgB,EAC7B,mBAAmB,EACnB,OAAO,CACR,CAAC;IACJ,CAAC;CACF;AAED,qEAAqE;AACrE,MAAM,UAAU,UAAU,CAAC,KAAc;IACvC,OAAO,KAAK,YAAY,QAAQ,CAAC;AACnC,CAAC"}

package/dist/Foundation/EventBus.js.map

@@ -1 +1 @@
-{"version":3,"file":"EventBus.js","sourceRoot":"","sources":["../../src/Foundation/EventBus.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AAGH,OAAO,EAAE,SAAS,EAAE,MAAM,aAAa,CAAC;AAExC,MAAM,MAAM,GAAG,IAAI,SAAS,CAAC,UAAU,CAAC,CAAC;AAsEzC;;;;;;GAMG;AACH,MAAM,OAAO,QAAQ;IACX,MAAM,CAAC,SAAS,GAAoB,IAAI,CAAC;IAEzC,SAAS,GAAG,IAAI,GAAG,EAA8B,CAAC;IAClD,iBAAiB,GAAG,IAAI,GAAG,EAAmC,CAAC;IAEvE,MAAM,KAAK,MAAM;QACf,IAAI,CAAC,QAAQ,CAAC,SAAS,EAAE,CAAC;YACxB,QAAQ,CAAC,SAAS,GAAG,IAAI,QAAQ,EAAE,CAAC;QACtC,CAAC;QACD,OAAO,QAAQ,CAAC,SAAS,CAAC;IAC5B,CAAC;IAED;;;OAGG;IACH,EAAE,CAA8B,SAAY,EAAE,QAAuC;QACnF,MAAM,GAAG,GAAG,SAAmB,CAAC;QAChC,IAAI,CAAC,IAAI,CAAC,SAAS,CAAC,GAAG,CAAC,GAAG,CAAC,EAAE,CAAC;YAC7B,IAAI,CAAC,SAAS,CAAC,GAAG,CAAC,GAAG,EAAE,IAAI,GAAG,EAAE,CAAC,CAAC;QACrC,CAAC;QACD,MAAM,GAAG,GAAG,IAAI,CAAC,SAAS,CAAC,GAAG,CAAC,GAAG,CAAE,CAAC;QACrC,GAAG,CAAC,GAAG,CAAC,QAAyB,CAAC,CAAC;QAEnC,OAAO,GAAG,EAAE;YACV,GAAG,CAAC,MAAM,CAAC,QAAyB,CAAC,CAAC;YACtC,IAAI,GAAG,CAAC,IAAI,KAAK,CAAC,EAAE,CAAC;gBACnB,IAAI,CAAC,SAAS,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC;YAC7B,CAAC;QACH,CAAC,CAAC;IACJ,CAAC;IAED;;;OAGG;IACH,KAAK,CAAC,QAAyC;QAC7C,IAAI,CAAC,iBAAiB,CAAC,GAAG,CAAC,QAAQ,CAAC,CAAC;QACrC,OAAO,GAAG,EAAE;YACV,IAAI,CAAC,iBAAiB,CAAC,MAAM,CAAC,QAAQ,CAAC,CAAC;QAC1C,CAAC,CAAC;IACJ,CAAC;IAED;;OAEG;IACH,IAAI,CAA8B,SAAY,EAAE,QAAuC;QACrF,MAAM,WAAW,GAAG,IAAI,CAAC,EAAE,CAAC,SAAS,EAAE,CAAC,KAAK,EAAE,EAAE;YAC/C,WAAW,EAAE,CAAC;YACd,QAAQ,CAAC,KAAK,CAAC,CAAC;QAClB,CAAC,CAAC,CAAC;QACH,OAAO,WAAW,CAAC;IACrB,CAAC;IAED;;OAEG;IACH,IAAI,CAA8B,SAAY,EAAE,QAAsB,EAAE,IAAqB;QAC3F,MAAM,GAAG,GAAG,SAAmB,CAAC;QAChC,MAAM,OAAO,GAAG,CAAC,IAAI,IAAI,EAAE,CAA4B,CAAC;QACxD,MAAM,QAAQ,GAAqB;YACjC,IAAI,EAAE,GAAG;YACT,QAAQ;YACR,SAAS,EAAE,IAAI,CAAC,GAAG,EAAE;YACrB,IAAI,EAAE,OAAO;SACd,CAAC;QAEF,4BAA4B;QAC5B,MAAM,QAAQ,GAAG,IAAI,CAAC,SAAS,CAAC,GAAG,CAAC,GAAG,CAAC,CAAC;QACzC,IAAI,QAAQ,EAAE,CAAC;YACb,KAAK,MAAM,QAAQ,IAAI,QAAQ,EAAE,CAAC;gBAChC,IAAI,CAAC;oBACH,QAAQ,CAAC,OAAO,CAAC,CAAC;gBACpB,CAAC;gBAAC,OAAO,KAAK,EAAE,CAAC;oBACf,MAAM,CAAC,KAAK,CAAC,sBAAsB,GAAG,KAAK,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,KAAK,CAAC,EAAE,CAAC,CAAC;gBACvG,CAAC;YACH,CAAC;QACH,CAAC;QAED,4BAA4B;QAC5B,KAAK,MAAM,QAAQ,IAAI,IAAI,CAAC,iBAAiB,EAAE,CAAC;YAC9C,IAAI,CAAC;gBACH,QAAQ,CAAC,QAAQ,CAAC,CAAC;YACrB,CAAC;YAAC,OAAO,KAAK,EAAE,CAAC;gBACf,MAAM,CAAC,KAAK,CAAC,4BAA4B,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,KAAK,CAAC,EAAE,CAAC,CAAC;YACrG,CAAC;QACH,CAAC;IACH,CAAC;IAED;;OAEG;IACH,SAAS;QACP,IAAI,CAAC,SAAS,CAAC,KAAK,EAAE,CAAC;QACvB,IAAI,CAAC,iBAAiB,CAAC,KAAK,EAAE,CAAC;IACjC,CAAC;IAED,oCAAoC;IACpC,MAAM,CAAC,KAAK;QACV,IAAI,QAAQ,CAAC,SAAS,EAAE,CAAC;YACvB,QAAQ,CAAC,SAAS,CAAC,SAAS,EAAE,CAAC;QACjC,CAAC;QACD,QAAQ,CAAC,SAAS,GAAG,IAAI,CAAC;IAC5B,CAAC"}
+{"version":3,"file":"EventBus.js","sourceRoot":"","sources":["../../src/Foundation/EventBus.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AAGH,OAAO,EAAE,SAAS,EAAE,MAAM,aAAa,CAAC;AAExC,MAAM,MAAM,GAAG,IAAI,SAAS,CAAC,UAAU,CAAC,CAAC;AAwEzC;;;;;;GAMG;AACH,MAAM,OAAO,QAAQ;IACX,MAAM,CAAC,SAAS,GAAoB,IAAI,CAAC;IAEzC,SAAS,GAAG,IAAI,GAAG,EAA8B,CAAC;IAClD,iBAAiB,GAAG,IAAI,GAAG,EAAmC,CAAC;IAEvE,MAAM,KAAK,MAAM;QACf,IAAI,CAAC,QAAQ,CAAC,SAAS,EAAE,CAAC;YACxB,QAAQ,CAAC,SAAS,GAAG,IAAI,QAAQ,EAAE,CAAC;QACtC,CAAC;QACD,OAAO,QAAQ,CAAC,SAAS,CAAC;IAC5B,CAAC;IAED;;;OAGG;IACH,EAAE,CAA8B,SAAY,EAAE,QAAuC;QACnF,MAAM,GAAG,GAAG,SAAmB,CAAC;QAChC,IAAI,CAAC,IAAI,CAAC,SAAS,CAAC,GAAG,CAAC,GAAG,CAAC,EAAE,CAAC;YAC7B,IAAI,CAAC,SAAS,CAAC,GAAG,CAAC,GAAG,EAAE,IAAI,GAAG,EAAE,CAAC,CAAC;QACrC,CAAC;QACD,MAAM,GAAG,GAAG,IAAI,CAAC,SAAS,CAAC,GAAG,CAAC,GAAG,CAAE,CAAC;QACrC,GAAG,CAAC,GAAG,CAAC,QAAyB,CAAC,CAAC;QAEnC,OAAO,GAAG,EAAE;YACV,GAAG,CAAC,MAAM,CAAC,QAAyB,CAAC,CAAC;YACtC,IAAI,GAAG,CAAC,IAAI,KAAK,CAAC,EAAE,CAAC;gBACnB,IAAI,CAAC,SAAS,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC;YAC7B,CAAC;QACH,CAAC,CAAC;IACJ,CAAC;IAED;;;OAGG;IACH,KAAK,CAAC,QAAyC;QAC7C,IAAI,CAAC,iBAAiB,CAAC,GAAG,CAAC,QAAQ,CAAC,CAAC;QACrC,OAAO,GAAG,EAAE;YACV,IAAI,CAAC,iBAAiB,CAAC,MAAM,CAAC,QAAQ,CAAC,CAAC;QAC1C,CAAC,CAAC;IACJ,CAAC;IAED;;OAEG;IACH,IAAI,CAA8B,SAAY,EAAE,QAAuC;QACrF,MAAM,WAAW,GAAG,IAAI,CAAC,EAAE,CAAC,SAAS,EAAE,CAAC,KAAK,EAAE,EAAE;YAC/C,WAAW,EAAE,CAAC;YACd,QAAQ,CAAC,KAAK,CAAC,CAAC;QAClB,CAAC,CAAC,CAAC;QACH,OAAO,WAAW,CAAC;IACrB,CAAC;IAED;;OAEG;IACH,IAAI,CAA8B,SAAY,EAAE,QAAsB,EAAE,IAAqB;QAC3F,MAAM,GAAG,GAAG,SAAmB,CAAC;QAChC,MAAM,OAAO,GAAG,CAAC,IAAI,IAAI,EAAE,CAA4B,CAAC;QACxD,MAAM,QAAQ,GAAqB;YACjC,IAAI,EAAE,GAAG;YACT,QAAQ;YACR,SAAS,EAAE,IAAI,CAAC,GAAG,EAAE;YACrB,IAAI,EAAE,OAAO;SACd,CAAC;QAEF,4BAA4B;QAC5B,MAAM,QAAQ,GAAG,IAAI,CAAC,SAAS,CAAC,GAAG,CAAC,GAAG,CAAC,CAAC;QACzC,IAAI,QAAQ,EAAE,CAAC;YACb,KAAK,MAAM,QAAQ,IAAI,QAAQ,EAAE,CAAC;gBAChC,IAAI,CAAC;oBACH,QAAQ,CAAC,OAAO,CAAC,CAAC;gBACpB,CAAC;gBAAC,OAAO,KAAK,EAAE,CAAC;oBACf,MAAM,CAAC,KAAK,CAAC,sBAAsB,GAAG,KAAK,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,KAAK,CAAC,EAAE,CAAC,CAAC;gBACvG,CAAC;YACH,CAAC;QACH,CAAC;QAED,4BAA4B;QAC5B,KAAK,MAAM,QAAQ,IAAI,IAAI,CAAC,iBAAiB,EAAE,CAAC;YAC9C,IAAI,CAAC;gBACH,QAAQ,CAAC,QAAQ,CAAC,CAAC;YACrB,CAAC;YAAC,OAAO,KAAK,EAAE,CAAC;gBACf,MAAM,CAAC,KAAK,CAAC,4BAA4B,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,KAAK,CAAC,EAAE,CAAC,CAAC;YACrG,CAAC;QACH,CAAC;IACH,CAAC;IAED;;OAEG;IACH,SAAS;QACP,IAAI,CAAC,SAAS,CAAC,KAAK,EAAE,CAAC;QACvB,IAAI,CAAC,iBAAiB,CAAC,KAAK,EAAE,CAAC;IACjC,CAAC;IAED,oCAAoC;IACpC,MAAM,CAAC,KAAK;QACV,IAAI,QAAQ,CAAC,SAAS,EAAE,CAAC;YACvB,QAAQ,CAAC,SAAS,CAAC,SAAS,EAAE,CAAC;QACjC,CAAC;QACD,QAAQ,CAAC,SAAS,GAAG,IAAI,CAAC;IAC5B,CAAC"}

package/dist/Foundation/StructOffsets.js

@@ -1,161 +1,11 @@
 /**
- * RunAnywhere Web SDK - WASM Struct Field Offsets
+ * RunAnywhere Web SDK - Struct Offset Types
  *
- * C struct field offsets depend on alignment, padding, pointer size (wasm32
- * vs wasm64) and compiler flags. Hard-coding them in TypeScript is fragile
- * and leads to silent data corruption when the C layout changes.
+ * Core is now pure TypeScript. Struct offset loading happens in each
+ * backend package's bridge (LlamaCppBridge, SherpaONNXBridge).
  *
- * This module queries `rac_wasm_offsetof_*()` helpers (compiled via
- * `offsetof()` in wasm_exports.cpp) exactly once after the WASM module is
- * loaded, and caches the results for the lifetime of the page.
- *
- * Usage:
- *   import { Offsets, loadOffsets } from '../Foundation/StructOffsets';
- *
- *   // Called once during SDK init (after WASM load):
- *   loadOffsets(wasmModule);
- *
- *   // Then anywhere:
- *   m.setValue(optPtr + Offsets.llmOptions.temperature, 0.8, 'float');
- */
-// ---------------------------------------------------------------------------
-// Singleton
-// ---------------------------------------------------------------------------
-let _offsets = null;
-/**
- * Get the cached struct offsets. Throws if `loadOffsets()` hasn't been called.
- */
-export function getOffsets() {
-    if (!_offsets) {
-        throw new Error('StructOffsets not loaded — call loadOffsets(module) after WASM init');
-    }
-    return _offsets;
-}
-/**
- * Convenience re-export so callers can write `Offsets.vlmResult.text`.
- */
-export const Offsets = new Proxy({}, {
-    get(_target, prop) {
-        return getOffsets()[prop];
-    },
-});
-/**
- * Read all struct field offsets from the WASM module and cache them.
- * Must be called exactly once, after the WASM module is loaded.
- *
- * @param m - The Emscripten WASM module instance
- */
-export function loadOffsets(m) {
-    // Helper: safely call an offset function, returning 0 if it doesn't exist
-    // (e.g. when a backend wasn't compiled in).
-    const off = (name) => {
-        const fn = m[`_rac_wasm_offsetof_${name}`];
-        return typeof fn === 'function' ? fn() : 0;
-    };
-    const sz = (name) => {
-        const fn = m[`_rac_wasm_sizeof_${name}`];
-        return typeof fn === 'function' ? fn() : 0;
-    };
-    _offsets = {
-        config: {
-            logLevel: off('config_log_level'),
-        },
-        llmOptions: {
-            maxTokens: off('llm_options_max_tokens'),
-            temperature: off('llm_options_temperature'),
-            topP: off('llm_options_top_p'),
-        },
-        llmResult: {
-            text: off('llm_result_text'),
-            promptTokens: off('llm_result_prompt_tokens'),
-            completionTokens: off('llm_result_completion_tokens'),
-        },
-        vlmImage: {
-            format: off('vlm_image_format'),
-            filePath: off('vlm_image_file_path'),
-            pixelData: off('vlm_image_pixel_data'),
-            base64Data: off('vlm_image_base64_data'),
-            width: off('vlm_image_width'),
-            height: off('vlm_image_height'),
-            dataSize: off('vlm_image_data_size'),
-        },
-        vlmOptions: {
-            maxTokens: off('vlm_options_max_tokens'),
-            temperature: off('vlm_options_temperature'),
-            topP: off('vlm_options_top_p'),
-            streamingEnabled: off('vlm_options_streaming_enabled'),
-            systemPrompt: off('vlm_options_system_prompt'),
-            modelFamily: off('vlm_options_model_family'),
-        },
-        vlmResult: {
-            text: off('vlm_result_text'),
-            promptTokens: off('vlm_result_prompt_tokens'),
-            imageTokens: off('vlm_result_image_tokens'),
-            completionTokens: off('vlm_result_completion_tokens'),
-            totalTokens: off('vlm_result_total_tokens'),
-            timeToFirstTokenMs: off('vlm_result_time_to_first_token_ms'),
-            imageEncodeTimeMs: off('vlm_result_image_encode_time_ms'),
-            totalTimeMs: off('vlm_result_total_time_ms'),
-            tokensPerSecond: off('vlm_result_tokens_per_second'),
-        },
-        structuredOutputConfig: {
-            jsonSchema: off('structured_output_config_json_schema'),
-            includeSchemaInPrompt: off('structured_output_config_include_schema'),
-        },
-        structuredOutputValidation: {
-            isValid: off('structured_output_validation_is_valid'),
-            errorMessage: off('structured_output_validation_error_message'),
-            extractedJson: off('structured_output_validation_extracted_json'),
-        },
-        embeddingsOptions: {
-            normalize: off('embeddings_options_normalize'),
-            pooling: off('embeddings_options_pooling'),
-            nThreads: off('embeddings_options_n_threads'),
-        },
-        embeddingsResult: {
-            embeddings: off('embeddings_result_embeddings'),
-            numEmbeddings: off('embeddings_result_num_embeddings'),
-            dimension: off('embeddings_result_dimension'),
-            processingTimeMs: off('embeddings_result_processing_time_ms'),
-            totalTokens: off('embeddings_result_total_tokens'),
-        },
-        embeddingVector: {
-            data: off('embedding_vector_data'),
-            dimension: off('embedding_vector_dimension'),
-            structSize: sz('embedding_vector'),
-        },
-        diffusionOptions: {
-            prompt: off('diffusion_options_prompt'),
-            negativePrompt: off('diffusion_options_negative_prompt'),
-            width: off('diffusion_options_width'),
-            height: off('diffusion_options_height'),
-            steps: off('diffusion_options_steps'),
-            guidanceScale: off('diffusion_options_guidance_scale'),
-            seed: off('diffusion_options_seed'),
-            scheduler: off('diffusion_options_scheduler'),
-            mode: off('diffusion_options_mode'),
-            denoiseStrength: off('diffusion_options_denoise_strength'),
-            reportIntermediate: off('diffusion_options_report_intermediate'),
-            progressStride: off('diffusion_options_progress_stride'),
-        },
-        diffusionResult: {
-            imageData: off('diffusion_result_image_data'),
-            imageSize: off('diffusion_result_image_size'),
-            width: off('diffusion_result_width'),
-            height: off('diffusion_result_height'),
-            seedUsed: off('diffusion_result_seed_used'),
-            generationTimeMs: off('diffusion_result_generation_time_ms'),
-            safetyFlagged: off('diffusion_result_safety_flagged'),
-        },
-    };
-}
-/**
- * Load offsets for a standalone WASM module (e.g. in a Web Worker).
- * Returns the offsets directly instead of storing them in the singleton.
- * Useful when the Worker has its own WASM instance.
+ * This file only exports the offset interface types for use by
+ * backend packages that need them.
  */
-export function loadOffsetsFromModule(m) {
-    loadOffsets(m);
-    return _offsets;
-}
+export {};
 //# sourceMappingURL=StructOffsets.js.map

package/dist/Foundation/StructOffsets.js.map

@@ -1 +1 @@
-{"version":3,"file":"StructOffsets.js","sourceRoot":"","sources":["../../src/Foundation/StructOffsets.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;GAmBG;AA+HH,8EAA8E;AAC9E,YAAY;AACZ,8EAA8E;AAE9E,IAAI,QAAQ,GAAsB,IAAI,CAAC;AAEvC;;GAEG;AACH,MAAM,UAAU,UAAU;IACxB,IAAI,CAAC,QAAQ,EAAE,CAAC;QACd,MAAM,IAAI,KAAK,CAAC,qEAAqE,CAAC,CAAC;IACzF,CAAC;IACD,OAAO,QAAQ,CAAC;AAClB,CAAC;AAED;;GAEG;AACH,MAAM,CAAC,MAAM,OAAO,GAAe,IAAI,KAAK,CAAC,EAAgB,EAAE;IAC7D,GAAG,CAAC,OAAO,EAAE,IAAI;QACf,OAAO,UAAU,EAAE,CAAC,IAAwB,CAAC,CAAC;IAChD,CAAC;CACF,CAAC,CAAC;AAEH;;;;;GAKG;AACH,MAAM,UAAU,WAAW,CAAC,CAAM;IAChC,0EAA0E;IAC1E,4CAA4C;IAC5C,MAAM,GAAG,GAAG,CAAC,IAAY,EAAU,EAAE;QACnC,MAAM,EAAE,GAAG,CAAC,CAAC,sBAAsB,IAAI,EAAE,CAAC,CAAC;QAC3C,OAAO,OAAO,EAAE,KAAK,UAAU,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,CAAC,CAAC;IAC7C,CAAC,CAAC;IAEF,MAAM,EAAE,GAAG,CAAC,IAAY,EAAU,EAAE;QAClC,MAAM,EAAE,GAAG,CAAC,CAAC,oBAAoB,IAAI,EAAE,CAAC,CAAC;QACzC,OAAO,OAAO,EAAE,KAAK,UAAU,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,CAAC,CAAC;IAC7C,CAAC,CAAC;IAEF,QAAQ,GAAG;QACT,MAAM,EAAE;YACN,QAAQ,EAAE,GAAG,CAAC,kBAAkB,CAAC;SAClC;QAED,UAAU,EAAE;YACV,SAAS,EAAE,GAAG,CAAC,wBAAwB,CAAC;YACxC,WAAW,EAAE,GAAG,CAAC,yBAAyB,CAAC;YAC3C,IAAI,EAAE,GAAG,CAAC,mBAAmB,CAAC;SAC/B;QAED,SAAS,EAAE;YACT,IAAI,EAAE,GAAG,CAAC,iBAAiB,CAAC;YAC5B,YAAY,EAAE,GAAG,CAAC,0BAA0B,CAAC;YAC7C,gBAAgB,EAAE,GAAG,CAAC,8BAA8B,CAAC;SACtD;QAED,QAAQ,EAAE;YACR,MAAM,EAAE,GAAG,CAAC,kBAAkB,CAAC;YAC/B,QAAQ,EAAE,GAAG,CAAC,qBAAqB,CAAC;YACpC,SAAS,EAAE,GAAG,CAAC,sBAAsB,CAAC;YACtC,UAAU,EAAE,GAAG,CAAC,uBAAuB,CAAC;YACxC,KAAK,EAAE,GAAG,CAAC,iBAAiB,CAAC;YAC7B,MAAM,EAAE,GAAG,CAAC,kBAAkB,CAAC;YAC/B,QAAQ,EAAE,GAAG,CAAC,qBAAqB,CAAC;SACrC;QAED,UAAU,EAAE;YACV,SAAS,EAAE,GAAG,CAAC,wBAAwB,CAAC;YACxC,WAAW,EAAE,GAAG,CAAC,yBAAyB,CAAC;YAC3C,IAAI,EAAE,GAAG,CAAC,mBAAmB,CAAC;YAC9B,gBAAgB,EAAE,GAAG,CAAC,+BAA+B,CAAC;YACtD,YAAY,EAAE,GAAG,CAAC,2BAA2B,CAAC;YAC9C,WAAW,EAAE,GAAG,CAAC,0BAA0B,CAAC;SAC7C;QAED,SAAS,EAAE;YACT,IAAI,EAAE,GAAG,CAAC,iBAAiB,CAAC;YAC5B,YAAY,EAAE,GAAG,CAAC,0BAA0B,CAAC;YAC7C,WAAW,EAAE,GAAG,CAAC,yBAAyB,CAAC;YAC3C,gBAAgB,EAAE,GAAG,CAAC,8BAA8B,CAAC;YACrD,WAAW,EAAE,GAAG,CAAC,yBAAyB,CAAC;YAC3C,kBAAkB,EAAE,GAAG,CAAC,mCAAmC,CAAC;YAC5D,iBAAiB,EAAE,GAAG,CAAC,iCAAiC,CAAC;YACzD,WAAW,EAAE,GAAG,CAAC,0BAA0B,CAAC;YAC5C,eAAe,EAAE,GAAG,CAAC,8BAA8B,CAAC;SACrD;QAED,sBAAsB,EAAE;YACtB,UAAU,EAAE,GAAG,CAAC,sCAAsC,CAAC;YACvD,qBAAqB,EAAE,GAAG,CAAC,yCAAyC,CAAC;SACtE;QAED,0BAA0B,EAAE;YAC1B,OAAO,EAAE,GAAG,CAAC,uCAAuC,CAAC;YACrD,YAAY,EAAE,GAAG,CAAC,4CAA4C,CAAC;YAC/D,aAAa,EAAE,GAAG,CAAC,6CAA6C,CAAC;SAClE;QAED,iBAAiB,EAAE;YACjB,SAAS,EAAE,GAAG,CAAC,8BAA8B,CAAC;YAC9C,OAAO,EAAE,GAAG,CAAC,4BAA4B,CAAC;YAC1C,QAAQ,EAAE,GAAG,CAAC,8BAA8B,CAAC;SAC9C;QAED,gBAAgB,EAAE;YAChB,UAAU,EAAE,GAAG,CAAC,8BAA8B,CAAC;YAC/C,aAAa,EAAE,GAAG,CAAC,kCAAkC,CAAC;YACtD,SAAS,EAAE,GAAG,CAAC,6BAA6B,CAAC;YAC7C,gBAAgB,EAAE,GAAG,CAAC,sCAAsC,CAAC;YAC7D,WAAW,EAAE,GAAG,CAAC,gCAAgC,CAAC;SACnD;QAED,eAAe,EAAE;YACf,IAAI,EAAE,GAAG,CAAC,uBAAuB,CAAC;YAClC,SAAS,EAAE,GAAG,CAAC,4BAA4B,CAAC;YAC5C,UAAU,EAAE,EAAE,CAAC,kBAAkB,CAAC;SACnC;QAED,gBAAgB,EAAE;YAChB,MAAM,EAAE,GAAG,CAAC,0BAA0B,CAAC;YACvC,cAAc,EAAE,GAAG,CAAC,mCAAmC,CAAC;YACxD,KAAK,EAAE,GAAG,CAAC,yBAAyB,CAAC;YACrC,MAAM,EAAE,GAAG,CAAC,0BAA0B,CAAC;YACvC,KAAK,EAAE,GAAG,CAAC,yBAAyB,CAAC;YACrC,aAAa,EAAE,GAAG,CAAC,kCAAkC,CAAC;YACtD,IAAI,EAAE,GAAG,CAAC,wBAAwB,CAAC;YACnC,SAAS,EAAE,GAAG,CAAC,6BAA6B,CAAC;YAC7C,IAAI,EAAE,GAAG,CAAC,wBAAwB,CAAC;YACnC,eAAe,EAAE,GAAG,CAAC,oCAAoC,CAAC;YAC1D,kBAAkB,EAAE,GAAG,CAAC,uCAAuC,CAAC;YAChE,cAAc,EAAE,GAAG,CAAC,mCAAmC,CAAC;SACzD;QAED,eAAe,EAAE;YACf,SAAS,EAAE,GAAG,CAAC,6BAA6B,CAAC;YAC7C,SAAS,EAAE,GAAG,CAAC,6BAA6B,CAAC;YAC7C,KAAK,EAAE,GAAG,CAAC,wBAAwB,CAAC;YACpC,MAAM,EAAE,GAAG,CAAC,yBAAyB,CAAC;YACtC,QAAQ,EAAE,GAAG,CAAC,4BAA4B,CAAC;YAC3C,gBAAgB,EAAE,GAAG,CAAC,qCAAqC,CAAC;YAC5D,aAAa,EAAE,GAAG,CAAC,iCAAiC,CAAC;SACtD;KACF,CAAC;AACJ,CAAC;AAED;;;;GAIG;AACH,MAAM,UAAU,qBAAqB,CAAC,CAAM;IAC1C,WAAW,CAAC,CAAC,CAAC,CAAC;IACf,OAAO,QAAS,CAAC;AACnB,CAAC"}
+{"version":3,"file":"StructOffsets.js","sourceRoot":"","sources":["../../src/Foundation/StructOffsets.ts"],"names":[],"mappings":"AAAA;;;;;;;;GAQG"}