@qvac/tts-ggml 0.13.0 → 0.14.0

package/README.md

@@ -17,6 +17,22 @@ LavaSR neural denoise + 48 kHz bandwidth-extension enhancement.  Unsure
 which checkpoint to stage? Start with [Choosing a model](#choosing-a-model).
 
 
+### CosyVoice3 Core ML sidecars
+
+Apple builds support optional CosyVoice3 Core ML sidecars through the native
+`speech-cpp` 2026-10-19 dependency. Export and placement details are in the
+[CosyVoice3 Core ML guide](https://github.com/tetherto/qvac-fabric-speech.cpp/blob/ea128498e23d20cd122729275e92361b11a361df/engines/tts/docs/cosyvoice3.md#core-ml-sidecars).
+Re-export existing CosyVoice3 LM sidecars with the updated exporter to include
+the cache feedback correction for consecutive predictions.
+
+The LM, flow frontend/decoder, F0 predictor and HiFT vocoder use resident
+sidecars when present and fall back to ggml when unavailable. HiFT exports
+use FP32 for waveform parity. Core ML chooses operation placement, so a
+sidecar does not guarantee ANE execution or a speed improvement.
+When a sidecar is present, `assessFit` returns an error with reason
+`coreml-memory-estimate-unavailable`; its memory usage is not projected.
+
+
 Runs in-process with a persistent native engine — the GGUFs, the S3Gen
 preload, the ggml backend, and any voice-conditioning tensors are
 loaded once and reused across every synthesis call.  GPU acceleration
@@ -675,6 +691,8 @@ Notes:
   engine runs its ggml graph on the GPU (falling back to the ggml CPU backend
   when no GPU backend initialises), a CPU engine keeps the scalar core.
   `denoiserBackendDevice` / `denoiserBackendId` in the stats report where it ran.
+- Android ARM Mali devices can use Vulkan for denoising with `config.useGPU: true`.
+  This path is validated on Pixel 9 Pro XL (Mali-G715).
 - The tts-cpp UL-UNAS forward is implemented in
   [qvac-fabric-speech.cpp#78](https://github.com/tetherto/qvac-fabric-speech.cpp/pull/78)
   (scalar CPU port, validated bit-close to the ONNX reference); it requires a
@@ -1072,20 +1090,16 @@ The combined desktop CUDA/Vulkan speech changes in
 [Vulkan #308](https://github.com/tetherto/qvac-fabric-speech.cpp/pull/308),
 including [CUDA #321](https://github.com/tetherto/qvac-fabric-speech.cpp/pull/321),
 merged to native master at `84b02694001cfea863167776dbc185474a816656`.
-This checkout consumes the merged [registry #423](https://github.com/tetherto/qvac-registry-vcpkg/pull/423)
-at `e31be272ecdf9f20970302ebf8a2943d47803001`: `speech-cpp` 2026-10-12#1
-pins that merged revision, and `ggml-speech` 2026-10-07#1 pins
-`06f1b66806626a635904f31db6914ad2d0e71197`. The earlier native `f4d4c257`
+The exact native dependency versions are declared in [vcpkg.json](vcpkg.json),
+and the registry configuration is declared in
+[vcpkg-configuration.json](vcpkg-configuration.json). The earlier native `f4d4c257`
 passed ten smaller-model CUDA/Vulkan cases; those results do not establish GPU
 validation of the final native revision or the packaged addon. Rebuild the addon
 before running its GPU tests. Native desktop results also do not establish
 Android support or speech-quality signoff.
 
-The registry `baseline` is the main commit containing #423. The shared exact
-`speech-cpp` overrides and backend implementation are already on qvac main.
-This baseline update completes the TTS registry configuration; packaged-addon
-CUDA/Vulkan inference still requires validation on provisioned GPU hosts before
-claiming a validated release.
+Packaged-addon CUDA/Vulkan inference still requires validation on provisioned
+GPU hosts before claiming a validated release.
 
 From `packages/tts-ggml`, resolve the checked-in manifest without building or
 downloading models (with `VCPKG_ROOT` set):
@@ -1128,7 +1142,29 @@ case completes. Run both files together without test filters: a successful full
 run has 12 passing tests, including the two completion checks, and no skips.
 Preflight only checks asset presence; actual model loading and inference must
 also pass. These commands cover TTS, TTSD and Speech, not MOSS-SoundEffect (SFX).
-No addon CUDA/Vulkan hardware run has been completed for this test change yet.
+To validate the fresh packaged addons on the provisioned Linux GPU runner,
+dispatch the existing integration workflow on the branch being tested:
+
+```sh
+gh workflow run integration-test-nx.yml --repo tetherto/qvac --ref <branch> -f moss_packaged_gpu=true
+```
+
+This opt-in mode retains the `release` environment gate and builds both addons
+from the dispatch SHA with build concurrency capped at two. It stages the fresh
+platform packages through `link:platform`, verifies that both CUDA and Vulkan
+plugins are present, then runs CUDA and Vulkan sequentially. Each backend must
+pass the 12 TTS/TTSD/Speech tests above, two SFX tests (including exact backend
+and no-fallback assertions for both GPU clips), and the focused ASR Spanish
+transcription test with default and hotword prompts. Fixture skips fail the run.
+CPU control cases remain part of the TTS/SFX suites.
+
+The runner stages q8_0 TTS/TTSD/Speech/SFX backbones and q5_0 Transcribe, with
+the required codec precision preserved. TTS/TTSD q8_0 are generated on the
+runner from the source checkpoints using the pinned native quantizer. The
+artifacts retain source pins, model and prebuild hashes, the fresh prebuilds,
+and per-backend logs/results; model weights are removed and never uploaded.
+This mode does not publish. A dispatched or building run is not GPU validation:
+only passing case logs from both backends establish packaged-addon coverage.
 
 Without strict mode, developer behavior is unchanged: an unpinned run accepts
 the normal GPU cascade, missing model directories skip tests, and missing
@@ -1720,4 +1756,9 @@ Apache-2.0.  See [LICENSE](./LICENSE).
 
 ## Pocket TTS
 
+The native `speech-cpp` dependency includes Pocket Metal, CUDA, Vulkan and
+OpenCL support in the native library. The JavaScript Pocket API continues
+to require `config.useGPU: false`; updating the native dependency does not
+remove that addon validation.
+
 See [Pocket TTS](docs/pocket-tts.md) for model conversion, addon/SDK usage, supported controls and validation commands.

package/docs/pocket-tts.md

@@ -1,7 +1,9 @@
 # Pocket TTS
 
-Pocket is an English, CPU-only TTS engine implemented in the Fabric speech
-library. It streams PCM16 audio through the `@qvac/tts-ggml` addon. Python
+Pocket is an English TTS engine implemented in the Fabric speech library.
+The native library supports CPU, Metal, CUDA, Vulkan and OpenCL; the
+`@qvac/tts-ggml` JavaScript API currently accepts CPU inference only.
+It streams PCM16 audio through the addon. Python
 is used only to convert weights and benchmark the upstream reference; it is
 not needed for native synthesis. Inference plugin and public SDK integration
 will follow in a separate change after the addon release.
@@ -139,22 +141,22 @@ audio and broad subjective quality evaluations remain outside this coverage.
 
 ## Native dependencies and measured performance
 
-The manifest requires speech-cpp and ggml-speech `2026-09-15` without changing
-`vcpkg-configuration.json`. These registered versions select the merged source
-commits `a976c4d63195601fcff8bfc0c2cdf3ef36fba539` (speech-cpp) and
-`59a0ca2c2bcd7de36c27d930f79e0c94cc0c2ff3` (ggml-speech).
-[Registry #367](https://github.com/tetherto/qvac-registry-vcpkg/pull/367)
-contains these packages. Pocket resolves CPU memory planning through the
+The exact native dependency versions are declared in [vcpkg.json](../vcpkg.json).
+The Pocket GPU implementation comes from the merged
+[Fabric #338](https://github.com/tetherto/qvac-fabric-speech.cpp/pull/338)
+change, registered in
+[registry #433](https://github.com/tetherto/qvac-registry-vcpkg/pull/433).
+Pocket resolves CPU memory planning through the
 backend registry, fixing the Linux/Android unresolved `ggml_graph_plan` import.
 The native fixes are merged in [ggml #92](https://github.com/tetherto/qvac-ext-ggml/pull/92)
 and [speech #251](https://github.com/tetherto/qvac-fabric-speech.cpp/pull/251).
 
-Before the addon-only review revision, these exact native port trees passed
+Before the addon-only review revision, the original CPU-only native dependency versions passed
 [the full prebuild and integration run](https://github.com/tetherto/qvac/actions/runs/34975293366)
 at Fabric `49d864d2e1a2070a4cb9872cd0f62319fdb9e839`: nine platform prebuilds
 and seven desktop integration lanes covering CPU, Metal, Vulkan and CUDA.
 That run validates the native dependencies; it does not validate subsequent
-JavaScript review changes. The same native pins also passed all 10 Pocket
+JavaScript review changes. Those original native pins also passed all 10 Pocket
 CTests with upstream numerical fixtures, static/dynamic CPU planner tests,
 and 116 selected Supertonic Metal operations against CPU. Six paired
 old-versus-merged native audio cases produced bit-identical PCM; this is