arcane-os 0.69.0 → 0.70.0

package/docs/reference/sdk-api.md

@@ -8844,13 +8844,14 @@ occurrences use source `ai-model-controller`; every load or unload owns one
 non-null operation ID shared by its state and progress occurrences. Public
 progress retains the exact selected `modelId`, `phase`, state, and nested
 file-progress field names. Browser-WASM download progress preserves
-`completed`, `total`, and `unit:'files'` and adds `loadedBytes`, `totalBytes`,
-`remainingBytes`, `bytesPerSecond`, `etaSeconds`, `activeTransfers`,
-`transferLimit`, and `transferMode`. Unknown totals, rates, remaining values,
-and ETAs are `null`; applications format the raw byte and second measures for
-display. Chunk-driven transfer changes are coalesced on a 250 ms cadence, while
-plan, active-worker, and completion boundaries publish immediately and the existing five-second
-heartbeat repeats the latest record.
+`completed`, `total`, and `unit:'files'`, with complete per-file `members`
+reporting stored shards. A member's `total` remains `null` until its complete
+response is stored, unless the HTTP range plan already establishes its shard
+total. `activeTransfers`, `transferLimit`, and `transferMode` describe the
+active download work. Closed shards, active-worker changes, and completion
+boundaries publish semantic progress; the existing heartbeat repeats the latest
+record. These fields describe files and shards, without byte-based display
+requirements or estimated transfer rates.
 Accessor-bearing provider status
 and malformed progress reject with `ARCANE_AI_PROVIDER_STATUS_INVALID` and
 `ARCANE_AI_PROVIDER_PROGRESS_INVALID`. After disposal, lifecycle operations fail with
@@ -9443,8 +9444,8 @@ console.log(provider.status().state); // unloaded
 ### Overview
 
 Adapts an existing DBOPFS instance into a complete multi-model, ordered
-multi-file cache without renaming its public methods. Each completed whole
-member or Range part is committed independently. An interrupted set
+multi-file cache without renaming its public methods. Every new full response
+or Range transfer is committed in ordered parts. An interrupted set
 is not a cache hit, but its completed members remain available to the next
 install so only missing work is fetched.
 
@@ -9462,25 +9463,26 @@ workers
 when the probe returns a usable total from exposed `Content-Range` or optional
 descriptor `bytes`. The mutable
 result contains `kind`, `tableName`, `downloadConcurrency`, the original
-`adapter`, and `ready`, `install`, `ensure`, and `remove`. `ensure()` returns
+`adapter`, and `ready`, `install`, `ensure`, `remove`, and `fetchResource`. `ensure()` returns
 `files` and `cache:'cached'|'installed'`. It preserves the complete model content.
 `offline:true` never downloads and rejects a miss with
 `ARCANE_AI_MODEL_OFFLINE_MISS`.
 
-When supplied, `onProgress` receives existing ordered file progress plus
-`loadedBytes`, `totalBytes`, `remainingBytes`, `bytesPerSecond`, `etaSeconds`,
-`activeTransfers`, `transferLimit`, and `transferMode`. `activeTransfers` is the
-current transfer-worker count. Transfer mode is
-`probing`, `files`, `ranges`, or `single`. Unknown aggregate totals, remaining
-values, rates, and ETAs are `null`. Chunk-driven changes are coalesced on a
-250 ms cadence, with immediate records at download start, plan or total
-discovery, active-worker changes, and completion. `loadedBytes` includes current staged writes and
-restored completed members or Range parts; bytes from a failed partial write
-are removed from the total when that entry is discarded. A complete set of
-declared member `bytes` values
-makes split-model total and remaining progress available from the start;
-otherwise aggregate-dependent fields remain `null` until they are honestly
-known.
+When supplied, `onProgress` receives ordered file progress and `members`
+records with each file's `name`, committed `completed` parts, `total`, and
+`unit:'shards'`. Streaming totals remain `null` until the response finishes;
+previously complete files identify `state:'cached'`. `activeTransfers` is the
+current transfer-worker count, `transferLimit` is selected concurrency, and
+`transferMode` is `probing`, `files`, `ranges`, or `single`. Closed-part and
+lifecycle changes publish promptly, with an existing 250 ms heartbeat. No
+byte progress, transfer rate, or estimated completion time is produced.
+
+`fetchResource(input,{signal,onProgress,...requestOptions})` returns
+`{file,status,statusText,headers,url,redirected}` for a complete stored Fetch
+response. SDK browser model loaders use this shared owner for configuration,
+tokenizer, graph, external-data, and other fetched resources. Successful
+complete GET resources may be reused; supported HTTP ranges resume closed
+parts after interruption. Request framing stays at the transport boundary.
 
 ### Availability and normalization
 
@@ -9491,9 +9493,9 @@ resumable Range parts. For any source member, a followed redirect that
 turns the first `bytes=0-0` probe into `200` triggers one direct probe of the
 final URL. Confirmed support cancels the original body and starts the Range
 pool; refusal keeps the original response as the ordinary single-fetch path,
-with readable `Content-Length` used for progress. A missing `Content-Range` can
+without requiring a readable `Content-Length`. A missing `Content-Range` can
 use optional descriptor `bytes` for Range planning; without either total, the
-store falls back to one full fetch. A confirmed source member is divided into
+store uses one full fetch streamed into ordered persistent parts. A confirmed source member is divided into
 deterministic OPFS Range parts of roughly 4 MB each, up to 4,096 parts. A
 monolithic source may use at most
 `downloadConcurrency` Range workers; split sources keep one Range worker per
@@ -9502,7 +9504,7 @@ in order as one logical Blob. A later non-206, contradictory exposed Range
 response, or incorrectly framed body fails rather than assembling partial
 content. On failure or cancellation, peers settle while completed shards and
 Range parts remain available for retry; an unfinished active part restarts after
-refresh. A persisted Range part whose length does not match its requested HTTP
+refresh. Existing whole-file caches remain readable without migration. A persisted Range part whose length does not match its requested HTTP
 frame is discarded and fetched again. A complete whole member supersedes its
 redundant current Range fragments. Cleanup failure is warned without
 hiding the usable model. Wllama requires every selected model Blob or File to
@@ -9784,7 +9786,7 @@ retains the complete list of deletions already completed.
 
 Adapts an existing DBOPFS instance into a complete caller-selected speech
 runtime/model store. It serializes each selected model with an exclusive Web
-Lock, removes partial state after failure, stores ordinary mutable selection
+Lock, preserves complete peer files and closed parts after failure, stores ordinary mutable selection
 metadata before content, and treats a changed file inventory or source mapping
 as a cache miss that is downloaded again.
 
@@ -9794,7 +9796,7 @@ as a cache miss that is downloaded again.
 createDbopfsSpeechArtifactStore({ dbopfs, tableName='arcane_ai_browser_speech', fetchImpl=null, objectUrlFactory=null }={})
 ```
 
-The mutable result is `{protocol,tableName,prepare,remove}`.
+The mutable result is `{protocol,tableName,prepare,remove,fetchResource}`.
 `prepare(authority,{signal,onProgress,offline=false,security})` uses a complete
 compatible cache or downloads every declared file, preserves complete content
 and materializes object URLs, then returns
@@ -9804,9 +9806,18 @@ needs those URLs. `offline:true` never fetches and rejects a miss with
 authority's files and selection metadata. Optional `onProgress` receives
 preparation and download records with `phase`, `stage`, `message`, and the
 current `file` when available. File operations report actual `completed` and
-`total` inventory counts with `unit:'files'`; module preparation uses
+`total` inventory counts with `unit:'files'`, and `resource` carries the current
+closed-part progress with `unit:'shards'`; module preparation uses
 `total:null`. Cancellation stops progress along with the owning operation.
 
+New files stream into ordered DBOPFS parts with no required response length.
+Existing complete whole files stay readable without migration.
+`fetchResource(input,{signal,onProgress,...requestOptions})` returns
+`{file,status,statusText,headers,url,redirected}` and gives the dedicated
+speech Worker the same complete resource storage owner for runtime fetches.
+Native ESM imports and unmapped classic Worker internals retain their platform
+loader; they are not claimed as intercepted HTTP fetches.
+
 ### Availability and normalization
 
 **Browser with a ready DBOPFS instance, OPFS, Web Locks, Fetch or an injected

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "arcane-os",
-  "version": "0.69.0",
+  "version": "0.70.0",
   "description": "Arcane OS JavaScript SDK, project-local CLI, browser runtime, and repository-portable application packager.",
   "type": "module",
   "main": "./src/index.mjs",
@@ -123,7 +123,7 @@
     "test": "npm run test:unit && npm run test:functional && npm run test:integration && npm run test:regression",
     "test:release": "node ./bin/arcane-test.mjs test/npm-release.test.mjs",
     "test:unit": "node ./bin/arcane-test.mjs test/app-descriptor.test.mjs test/app-schema.test.mjs test/app-selection.test.mjs test/contracts.test.mjs test/conversation-closing-report.test.mjs test/doctor.test.mjs test/mail-credentials.test.mjs test/mail-outbox.test.mjs test/mail-public-api.test.mjs test/mail-send.test.mjs test/mail-transport.test.mjs test/native-windows-icon.test.mjs test/targets.test.mjs test/workspace-operation-lock.test.mjs",
-    "test:functional": "node ./bin/arcane-test.mjs test/ai-ollama-readiness.test.mjs test/core-ollama-lifecycle.test.mjs test/ai-request-model.test.mjs test/ai-request-retry.test.mjs test/ai-stream-cancellation.test.mjs test/browser-decisions.test.mjs test/browser-speech-providers.test.mjs test/browser-wasm-gpu-notice.test.mjs test/browser-wasm-download-resume.test.mjs test/chat-input.test.mjs test/chat-stream-speech.test.mjs test/chat-transcript-scroll.test.mjs test/chat-transient-retention.test.mjs test/cli.test.mjs test/continuous-voice-capture.test.mjs test/codex-app-server.test.mjs test/mcp-stdio-server.test.mjs test/core-classic-source.test.mjs test/core-client.test.mjs test/core-client-installation.test.mjs test/core-ai-installation.test.mjs test/core-llama-lifecycle.test.mjs test/core-development.test.mjs test/core-host.test.mjs test/core-model-assets.test.mjs test/core-native-services.test.mjs test/core-packaged-web.test.mjs test/core-runtime.test.mjs test/core-stdio.test.mjs test/dbopfs-document-library.test.mjs test/dbopfs-png.test.mjs test/dbopfs.test.mjs test/dev-server.test.mjs test/dev-pwa.test.mjs test/dom-event-instrumentation.test.mjs test/event-manager.test.mjs test/events.test.mjs test/file-preview.test.mjs test/import-map.test.mjs test/local-image-editing.test.mjs test/mail-cli.test.mjs test/mail-runtime.test.mjs test/mail-server.test.mjs test/markdown-editor.test.mjs test/markdown-media.test.mjs test/markdown-source-map.test.mjs test/modal.test.mjs test/native-decisions.test.mjs test/native-onnx.test.mjs test/native-module-packaging.test.mjs test/native-module-resource-references.test.mjs test/packaging.test.mjs test/pwa-packaging.test.mjs test/pwa-client.test.mjs test/pwa-install.test.mjs test/pwa-worker.test.mjs test/persistent-ai-chat-session.test.mjs test/reference-completeness.test.mjs test/rendered-print.test.mjs test/runtime-api-behavior.test.mjs test/runtime.test.mjs test/scaffold.test.mjs test/speech-playback.test.mjs test/site.test.mjs test/theme-manager.test.mjs test/twin-cloud-images.test.mjs test/twin-cloud.test.mjs test/websocket-client-import-map.test.mjs test/websocket.test.mjs test/update-check.test.mjs test/user-explicit-updates.test.mjs",
+    "test:functional": "node ./bin/arcane-test.mjs test/ai-ollama-readiness.test.mjs test/core-ollama-lifecycle.test.mjs test/ai-request-model.test.mjs test/ai-request-retry.test.mjs test/ai-stream-cancellation.test.mjs test/browser-decisions.test.mjs test/browser-speech-providers.test.mjs test/browser-speech-artifacts.test.mjs test/browser-speech-resource-bridge.test.mjs test/browser-wasm-gpu-notice.test.mjs test/browser-wasm-download-resume.test.mjs test/chat-input.test.mjs test/chat-stream-speech.test.mjs test/chat-transcript-scroll.test.mjs test/chat-transient-retention.test.mjs test/cli.test.mjs test/continuous-voice-capture.test.mjs test/codex-app-server.test.mjs test/mcp-stdio-server.test.mjs test/core-classic-source.test.mjs test/core-client.test.mjs test/core-client-installation.test.mjs test/core-ai-installation.test.mjs test/core-llama-lifecycle.test.mjs test/core-development.test.mjs test/core-host.test.mjs test/core-shared-host.test.mjs test/core-model-assets.test.mjs test/core-native-services.test.mjs test/core-packaged-web.test.mjs test/core-runtime.test.mjs test/core-stdio.test.mjs test/dbopfs-committed-events.test.mjs test/dbopfs-document-library.test.mjs test/dbopfs-model-resources.test.mjs test/dbopfs-png.test.mjs test/dbopfs.test.mjs test/dev-server.test.mjs test/dev-pwa.test.mjs test/dom-event-instrumentation.test.mjs test/event-manager.test.mjs test/events.test.mjs test/file-preview.test.mjs test/import-map.test.mjs test/local-image-editing.test.mjs test/mail-cli.test.mjs test/mail-runtime.test.mjs test/mail-server.test.mjs test/markdown-editor.test.mjs test/markdown-media.test.mjs test/markdown-source-map.test.mjs test/modal.test.mjs test/model-resource-bridge.test.mjs test/native-decisions.test.mjs test/native-onnx.test.mjs test/native-module-packaging.test.mjs test/native-module-resource-references.test.mjs test/packaging.test.mjs test/pwa-packaging.test.mjs test/pwa-client.test.mjs test/pwa-install.test.mjs test/pwa-worker.test.mjs test/persistent-ai-chat-session.test.mjs test/reference-completeness.test.mjs test/rendered-print.test.mjs test/runtime-api-behavior.test.mjs test/runtime.test.mjs test/scaffold.test.mjs test/speech-playback.test.mjs test/site.test.mjs test/theme-manager.test.mjs test/twin-cloud-images.test.mjs test/twin-cloud.test.mjs test/websocket-client-import-map.test.mjs test/websocket.test.mjs test/update-check.test.mjs test/user-explicit-updates.test.mjs",
     "test:integration": "node ./bin/arcane-test.mjs test/installed-package-runtime.test.mjs test/root-app-layout.test.mjs test/integrated-shared.test.mjs test/integrated-workspace.test.mjs test/mail-browser.test.mjs test/native-macos-provider.test.mjs test/native-plan.test.mjs test/native-portable-provider.test.mjs test/native-provider-loader.test.mjs test/npm-release.test.mjs test/release-bundle.test.mjs test/release-capability-smoke.test.mjs test/shared-payload-batch.test.mjs test/tarball.test.mjs test/browser-wasm-cpu.test.mjs test/wllama-webgpu-runtime.test.mjs",
     "test:regression": "node ./bin/arcane-test.mjs test/channel-workflows.test.mjs test/html-import-registration.test.mjs test/html-import-packaged-script.test.mjs test/logging-regression.test.mjs test/markdown-speech.test.mjs test/prepared-speech.test.mjs test/native-provider-generation.test.mjs test/speech-queue-regression.test.mjs test/testing.test.mjs test/test-sets.test.mjs",
     "check": "node tools/check-source.mjs && npm test",

package/runtime/arcane/modules/AI.js

@@ -1182,7 +1182,6 @@ class AI {
     #speechJobSequence=0;
     #stopOllamaReady=null;
     #ttsSegmentation={...DEFAULT_TTS_SEGMENTATION};
-    #preparedSpeechReadiness = null;
     #preparedSpeechPlaybacks = new Set();
     #nativeSpeechPlaybacks = new Set();
     #speechUnlockContext = null;
@@ -4394,7 +4393,7 @@ class AI {
                     runtime.#browserSpeechTransition,activation.controller.signal
                 );
                 activation.controller.signal.throwIfAborted();
-                await runtime.#providerRuntime.setSpeechMuted(false);
+                await runtime.#providerRuntime.setSpeechMuted(false, {signal: activation.controller.signal});
                 if(runtime.#speechActivation!==activation)return false;
                 const status=runtime.#providerRuntime.status('tts');
                 runtime.muted=status.state!=='ready'||status.loaded!==true;
@@ -6409,22 +6408,7 @@ class AI {
             if(selected) {
                 const status = runtime.#providerRuntime.status('tts');
                 if(status.state !== 'ready' || status.loaded !== true) {
-                    if(!runtime.#preparedSpeechReadiness) {
-                        const readiness = runtime.#providerRuntime.setSpeechMuted(false);
-                        runtime.#preparedSpeechReadiness = readiness;
-                        readiness.finally(
-                            function releasePreparedSpeechReadiness() {
-                                if(runtime.#preparedSpeechReadiness === readiness) {
-                                    runtime.#preparedSpeechReadiness = null;
-                                }
-                            }
-                        ).catch(
-                            function reportPreparedSpeechReadinessFailure(error) {
-                                runtime.#traceSpeech('prepareTTS.readiness.error', {error});
-                            }
-                        );
-                    }
-                    await runtime.#preparedSpeechReadiness;
+                    await runtime.#providerRuntime.setSpeechMuted(false, {signal: requestSignal});
                     assertPreparedSpeechSelection();
                 }
             }

package/runtime/arcane/modules/AIProviderRuntime.js

@@ -1688,6 +1688,7 @@ export class AIProviderRuntime {
     #speechDesiredMuted = true;
     #speechTransition = Promise.resolve();
     #speechTransitionOwners = 0;
+    #speechActivation = null;
     #unsubscribeIntents = null;
     #closed = false;
     #closing = false;
@@ -2784,6 +2785,11 @@ export class AIProviderRuntime {
         }
         if (slot.loadPromise) {
             if (this.#sameSelection(slot.selection, targetSelection)) {
+                const activation = this.#speechActivation;
+                if (role === 'tts' && activation?.loadPromise === slot.loadPromise
+                    && signal !== activation.controller.signal) {
+                    return this.#observeSpeechActivation(activation, signal);
+                }
                 return slot.loadPromise;
             }
             return Promise.reject(
@@ -2957,6 +2963,10 @@ export class AIProviderRuntime {
             }
         );
         slot.loadPromise = loadOperation;
+        if (role === 'tts' && this.#speechActivation
+            && signal === this.#speechActivation.controller.signal) {
+            this.#speechActivation.loadPromise = loadOperation;
+        }
         publishAIRuntimeRoleState(
             role,
             roleRecord(
@@ -4270,19 +4280,34 @@ export class AIProviderRuntime {
         return true;
     }
 
-    async setSpeechMuted(muted) {
+    async setSpeechMuted(muted, {signal = null} = {}) {
         arcaneLogging.debug('[Arcane speech runtime] setSpeechMuted', muted);
         this.#assertOpen();
         this.#assertNotConfiguring();
         if (!is.boolean(muted)) {
             fail('AI speech muted state must be a boolean.');
         }
+        assertAbortSignal(signal);
+        if (signal?.aborted) throw normalizedAbort(signal.reason);
+        if (!muted && !this.#speechDesiredMuted && this.#speechActivation
+            && !this.#speechActivation.controller.signal.aborted) {
+            return this.#observeSpeechActivation(this.#speechActivation, signal);
+        }
         this.#speechDesiredMuted = muted;
         if (muted) {
             this.#speechMuted = true;
+            this.#speechActivation?.controller.abort();
             this.#slots.tts.loadController?.abort();
             this.cancel('tts');
         }
+        const activation = muted ? null : {
+            controller: new AbortController(),
+            interests: new Set(),
+            promise: null,
+            loadPromise: null,
+            settled: false
+        };
+        this.#speechActivation = activation;
         const runtime = this;
         this.#speechTransitionOwners += 1;
         const transition = this.#speechTransition.catch(
@@ -4290,6 +4315,9 @@ export class AIProviderRuntime {
         ).then(
             async function reconcileLatestAISpeechPreference() {
                 while (true) {
+                    if (activation?.controller.signal.aborted) {
+                        throw normalizedAbort(activation.controller.signal.reason);
+                    }
                     const desiredMuted = runtime.#speechDesiredMuted;
                     if (desiredMuted) {
                         runtime.cancel('tts');
@@ -4306,7 +4334,11 @@ export class AIProviderRuntime {
                         if (runtime.#speechDesiredMuted) {
                             continue;
                         }
-                        await runtime.load('tts');
+                        const currentActivation = runtime.#speechActivation;
+                        if (currentActivation?.controller.signal.aborted) {
+                            throw normalizedAbort(currentActivation.controller.signal.reason);
+                        }
+                        await runtime.load('tts', {signal: currentActivation?.controller.signal ?? null});
                     }
                     if (runtime.#speechDesiredMuted === desiredMuted) {
                         runtime.#speechMuted = desiredMuted;
@@ -4318,10 +4350,52 @@ export class AIProviderRuntime {
         ).finally(
             function releaseAIProviderSpeechTransitionOwnership() {
                 runtime.#speechTransitionOwners -= 1;
+                if (activation) {
+                    activation.settled = true;
+                    if (runtime.#speechActivation === activation) {
+                        runtime.#speechActivation = null;
+                    }
+                }
             }
         );
         this.#speechTransition = transition;
-        return transition;
+        if (!activation) return transition;
+        activation.promise = transition;
+        return this.#observeSpeechActivation(activation, signal);
+    }
+
+    #observeSpeechActivation(activation, signal) {
+        return new Promise(function observeAIProviderSpeechActivation(resolve, reject) {
+            const interest = {};
+            let settled = false;
+            activation.interests.add(interest);
+            function releaseSpeechActivationInterest() {
+                activation.interests.delete(interest);
+                signal?.removeEventListener('abort', cancelSpeechActivationInterest);
+            }
+            function cancelSpeechActivationInterest() {
+                if (settled) return;
+                settled = true;
+                releaseSpeechActivationInterest();
+                if (!activation.settled && activation.interests.size === 0) {
+                    activation.controller.abort(signal?.reason);
+                }
+                reject(normalizedAbort(signal?.reason));
+            }
+            signal?.addEventListener('abort', cancelSpeechActivationInterest, {once: true});
+            activation.promise.then(function speechActivationReady(status) {
+                if (settled) return;
+                settled = true;
+                releaseSpeechActivationInterest();
+                resolve(status);
+            }, function speechActivationFailed(error) {
+                if (settled) return;
+                settled = true;
+                releaseSpeechActivationInterest();
+                reject(error);
+            });
+            if (signal?.aborted) cancelSpeechActivationInterest();
+        });
     }
 
     #providerFor(slot) {