zerotts 0.1.0__tar.gz

zerotts-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 ZeroWeight AI
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

zerotts-0.1.0/NOTICE

@@ -0,0 +1,36 @@
+ZeroTTS
+Copyright (c) 2026 ZeroWeight AI
+Licensed under the MIT License (see LICENSE).
+
+------------------------------------------------------------------------------
+This product redistributes third-party components.
+------------------------------------------------------------------------------
+
+MOSS-Audio-Tokenizer-Nano
+Copyright the OpenMOSS Team.
+Licensed under the Apache License, Version 2.0.
+Full text: LICENSES/MOSS-Audio-Tokenizer-Apache-2.0.txt
+
+The ZeroTTS weights repository (huggingface.co/zeroweight-ai/ZeroTTS) bundles
+the ONNX **decoder** graphs of MOSS-Audio-Tokenizer-Nano under onnx/codec/, so
+that ZeroTTS has no runtime dependency on an external model repository. The
+encoder graphs are not redistributed. The graphs are unmodified except for the
+removal of the encoder entries from the accompanying metadata file.
+
+  Upstream: https://github.com/OpenMOSS/MOSS-Audio-Tokenizer
+            https://huggingface.co/OpenMOSS-Team/MOSS-Audio-Tokenizer-Nano-ONNX
+
+------------------------------------------------------------------------------
+
+soe-vinorm
+Copyright (c) vinhdq842.
+Licensed under the MIT License.
+Full text: src/zerotts/text_norm/data/LICENSE.soe-vinorm
+
+src/zerotts/text_norm/vi_normalizer.py adapts soe-vinorm's Vietnamese number,
+date, time, version and fraction expansion rules, and vendors its abbreviation
+table as data/abbreviations.txt. None of soe-vinorm's machinery is carried over
+— that project tags tokens with a CRF and disambiguates acronyms with an ONNX
+scorer, both downloaded at runtime; this module is pure stdlib regex.
+
+  Upstream: https://github.com/vinhdq842/soe-vinorm

zerotts-0.1.0/PKG-INFO

@@ -0,0 +1,350 @@
+Metadata-Version: 2.4
+Name: zerotts
+Version: 0.1.0
+Summary: Lightweight Vietnamese Zero-Shot Text-to-Speech (TTS) with real-time streaming and voice cloning.
+Author: ZeroWeight AI
+License: MIT
+Project-URL: Homepage, https://github.com/zeroweight-ai/ZeroTTS
+Project-URL: Weights, https://huggingface.co/zeroweight-ai/ZeroTTS
+Project-URL: Benchmark, https://huggingface.co/datasets/zeroweight-ai/ZeroBench-TTS
+Keywords: tts,text-to-speech,vietnamese,onnx,speech-synthesis,lightweight,voice clone
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Topic :: Multimedia :: Sound/Audio :: Speech
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+License-File: LICENSE
+License-File: NOTICE
+Requires-Dist: numpy>=1.23
+Requires-Dist: onnxruntime>=1.17.0
+Requires-Dist: tokenizers>=0.20.0
+Requires-Dist: huggingface_hub>=0.23.0
+Requires-Dist: soundfile>=0.12.1
+Requires-Dist: scipy>=1.10.0
+Provides-Extra: webui
+Requires-Dist: gradio>=4.44.0; extra == "webui"
+Requires-Dist: fastapi>=0.110; extra == "webui"
+Requires-Dist: uvicorn>=0.27; extra == "webui"
+Requires-Dist: requests>=2.31; extra == "webui"
+Provides-Extra: eval
+Requires-Dist: torch>=2.4.0; extra == "eval"
+Requires-Dist: torchaudio>=2.4.0; extra == "eval"
+Requires-Dist: transformers>=4.44.0; extra == "eval"
+Requires-Dist: huggingface_hub>=0.23; extra == "eval"
+Requires-Dist: datasets>=2.19; extra == "eval"
+Requires-Dist: librosa>=0.10; extra == "eval"
+Requires-Dist: pandas>=2.0; extra == "eval"
+Requires-Dist: jiwer>=3.0; extra == "eval"
+Provides-Extra: dev
+Requires-Dist: pytest>=7.4; extra == "dev"
+Requires-Dist: ruff>=0.5; extra == "dev"
+Dynamic: license-file
+
+<div align="center">
+
+<img src="docs/assets/banner.png" alt="ZeroTTS — Vietnamese zero-shot text-to-speech" width="100%">
+
+# ZeroTTS
+
+### Vietnamese Zero-Shot Text-to-Speech (TTS) with real-time streaming and voice cloning from seconds of audio. Fast, natural, and optimised for CPU inference.
+
+[![PyPI](https://img.shields.io/pypi/v/zerotts?color=3775AB)](https://pypi.org/project/zerotts/)
+[![License](https://img.shields.io/badge/License-MIT-green.svg)](LICENSE)
+[![ONNX](https://img.shields.io/badge/ONNX-Runtime-005CED?logo=onnx&logoColor=white)](https://onnxruntime.ai/)
+[![HuggingFace](https://img.shields.io/badge/🤗-Weights-yellow)](https://huggingface.co/zeroweight-ai/ZeroTTS)
+[![Benchmark](https://img.shields.io/badge/🤗-ZeroBench--TTS-orange)](https://huggingface.co/datasets/zeroweight-ai/ZeroBench-TTS)
+
+</div>
+
+**The most accurate open Vietnamese TTS we know of — 4× fewer word errors than
+the next open model**, and it runs faster than real time on a laptop CPU.
+
+* 🗣️ **Zero-shot voice cloning** — cloned from as little as 3 seconds of reference
+  audio (up to 30 seconds). No fine-tuning, no per-speaker training.
+* ⚡ **Real-time on CPU, streaming** — ~2× faster than real time (RTF 0.5×),
+  first audio chunk in ~70 ms. No GPU required.
+* 🇻🇳 **Built for Vietnamese** — tones, code-switched English, and a built-in
+  normalizer that reads `31/12/2026` and `ZeroTTS` the way a person would.
+
+## Samples
+
+<table>
+<tr>
+<td width="33%" align="center"><b>Two-speaker conversation</b></td>
+<td width="33%" align="center"><b>Long-form narration</b></td>
+<td width="33%" align="center"><b>News read, code-switched English</b></td>
+</tr>
+<tr>
+<td width="33%"><video src="https://github.com/user-attachments/assets/7f97b370-4544-4df7-9165-ffad8a08eb90" controls width="100%"></video></td>
+<td width="33%"><video src="https://github.com/user-attachments/assets/3c80a328-11cc-4815-b3fb-97ca8d994401" controls width="100%"></video></td>
+<td width="33%"><video src="https://github.com/user-attachments/assets/9a5f6125-3ac3-4f09-81f1-986f38e18f69" controls width="100%"></video></td>
+</tr>
+</table>
+
+## Contents
+
+1. [Samples](#samples)
+2. [Install](#install)
+3. [Usage](#usage)
+4. [Voices — and voice cloning](#voices--and-voice-cloning)
+5. [Benchmarks](#benchmarks)
+6. [Web UI](#web-ui)
+7. [Browser demo](#browser-demo)
+8. [How it works](#how-it-works)
+9. [Credits](#credits)
+
+---
+
+## Install
+
+```bash
+pip install zerotts
+```
+
+That pulls `numpy`, `onnxruntime`, `tokenizers`, `huggingface_hub`, `soundfile`,
+`scipy` — and nothing else. Weights download from the Hub on first use
+(~900 MB, cached under `HF_HOME`).
+
+Optional extras:
+
+```bash
+pip install "zerotts[webui]"   # Gradio demo
+pip install "zerotts[eval]"    # benchmark scorers — these DO need torch
+```
+
+The `eval` extra is the only thing in this repo that installs PyTorch, and it is
+for *measuring* quality, not for generating audio.
+
+## Usage
+
+## Web UI
+
+```bash
+pip install "zerotts[webui]"
+python webui/app.py                       # http://localhost:7860
+python webui/app.py --model ./local_dir   # a local model directory
+```
+
+Voice picker, streaming playback, long-form segmentation, and the generation
+settings above.
+
+## Browser demo
+
+[`js/`](js/) runs the same model client-side with `onnxruntime-web` — no server,
+no upload. See [docs/BROWSER.md](docs/BROWSER.md).
+
+Note the download: the weights are **fp32 and not quantized**, so the demo fetches
+~900 MB once and persists it (OPFS/Cache API). That is a deliberate
+quality-over-size choice; it targets desktop broadband, not mobile data.
+
+### Python
+
+```python
+from zerotts import ZeroTTS
+
+tts = ZeroTTS.from_pretrained("zeroweight-ai/ZeroTTS")
+
+print(tts.list_voices())
+
+# One shot
+audio = tts.synthesize("Hôm nay trời đẹp quá.", voice="maichi")
+tts.save_audio(audio, "out.wav")
+
+# Streaming — first chunk arrives in ~70 ms
+import queue
+
+import numpy as np
+import sounddevice as sd   # pip install sounddevice
+
+TEXT = ("Đây là chế độ phát trực tuyến. Âm thanh được tạo ra và phát ngay lập tức, "
+        "không cần chờ toàn bộ đoạn văn hoàn thành. Nhờ vậy, người nghe chỉ mất "
+        "khoảng 70 mili giây là đã nghe thấy câu đầu tiên, ngay cả khi mô "
+        "hình đang chạy trên CPU của một chiếc laptop bình thường.")
+
+pending, tail = queue.Queue(), np.zeros(0, dtype="float32")
+
+def feed(outdata, frames, _time, _status):
+    global tail
+    while len(tail) < frames and not pending.empty():
+        tail = np.concatenate([tail, pending.get_nowait()])
+    n = min(frames, len(tail))
+    outdata[:n, 0] = tail[:n]
+    outdata[n:] = 0
+    tail = tail[n:]
+
+with sd.OutputStream(samplerate=tts.sample_rate, channels=1,
+                     dtype="float32", callback=feed):
+    for chunk in tts.synthesize_stream(TEXT, voice="maichi"):
+        pending.put(chunk.reshape(-1))   # chunk is (1, n) float32 at 48 kHz
+    while not pending.empty() or len(tail):
+        sd.sleep(50)                     # let the buffer drain before closing
+```
+
+Dates, clock times, fractions and acronyms are expanded to spoken Vietnamese
+before synthesis:
+
+```python
+from zerotts import normalize_vi_text
+
+normalize_vi_text("Ngày 23/8/2024 lúc 15h30, giá 1.250.000")
+# 'Ngày hai mươi ba tháng tám năm hai nghìn không trăm hai mươi tư lúc
+#  mười lăm giờ ba mươi phút, giá một triệu hai trăm năm mươi nghìn'
+```
+
+`synthesize()` does **not** apply it — it is a separate step so you stay in
+control (the expansions are Vietnamese words, so they are wrong for English
+text). The CLI and web UI apply it by default; `zerotts say --no_text_norm`
+turns it off.
+
+Long input should be segmented — the model is trained on utterances, not
+paragraphs:
+
+```python
+from zerotts.chunking import chunk_text, clean_segment_punctuation, normalize_punctuation
+
+segments = [clean_segment_punctuation(s)
+            for s in chunk_text(normalize_punctuation(long_text), max_chunk_sec=15)]
+```
+
+### Command line
+
+```bash
+zerotts voices
+zerotts say "Xin chào các bạn." --voice maichi -o hello.wav
+zerotts say "$(cat article.txt)" --voice maichi --chunk -o article.wav
+zerotts bench --voice maichi
+```
+
+### Generation settings
+
+| Argument | Default | Effect |
+|---|---|---|
+| `voice` | `None` | Voice pack name. `None` = the model's unconditional voice, which is *not* stable across runs. |
+| `cfg_scale` | `1.0` | `>1` guides toward the voice's identity, at 2× the per-frame cost. |
+| `audio_temperature` | `0.8` | |
+| `audio_topk` / `audio_topp` | `25` / `0.95` | |
+| `audio_repetition_penalty` | `1.2` | Benchmarked default. `1.0` measurably raises WER and leaves more dead air. |
+| `eoa_extra_frames` | `1` | Frames of trailing audio kept after the model signals stop. `0` clips the last phone's release. |
+
+Defaults are the exact settings the [benchmark numbers](#benchmarks) were
+produced with, so out-of-the-box output matches the published scores.
+
+## Voices — and voice cloning
+
+A voice in ZeroTTS is a small array of speaker latents, shape
+`(1, n_voice_queries, d_model)`. That array is the *entire* speaker
+conditioning — there is no reference transcript, no in-context audio prompt, no
+teacher-forced frames. It ships as a `.npz` inside the weights repo.
+
+> ### Voice cloning is not available in this release
+>
+> Those latents are produced by a voice encoder that reads a reference clip, and
+> **the voice encoder is not published**. This package can load voices; it cannot
+> create them from audio. There is no flag that turns this on.
+>
+> To get latents for your own speaker, visit
+> **[zeroweight.ai](https://zeroweight.ai)** or get in touch.
+
+The boundary is narrower than it sounds: latents obtained that way are just a
+`.npz`, so they drop into `voices/<name>/voice.npz` and work with no code change.
+
+Eight presets ship with the weights, each tagged by gender, age and register so
+you can pick one by ear or by filter — `maichi` (Mai Chi) is the default used
+throughout this README. Full list, tags, and preview clips:
+[docs/VOICES.md](docs/VOICES.md).
+
+```python
+tts.list_voices()                       # ['maichi', 'baotrang', ...]
+v = tts.load_voice("maichi")
+v.emb.shape                             # (1, 10, 768)
+v.display_name, v.gender, v.tags        # 'Mai Chi', 'nữ', ['nữ', 'trẻ', 'kể chuyện', ...]
+
+# A latent array from anywhere works directly
+audio = tts.synthesize("…", voice=my_latents)
+```
+
+## Benchmarks
+
+Measured on **[ZeroBench-TTS](https://huggingface.co/datasets/zeroweight-ai/ZeroBench-TTS)** 
+
+Every system reads **normalized text** — dates, numbers and acronyms already
+spoken out, from the benchmark's own curated reading. 
+
+| | **ZeroTTS** | OmniVoice | XTTS-v2-vietnamse | viXTTS |
+|---|:-:|:-:|:-:|:-:|
+| **WER** ↓ | **0.56 %** | 2.12 % | 7.27 % | 8.61 % |
+| **Naturalness** (UTMOS) ↑ | **2.91** | 2.75 | 2.49 | 2.34 |
+| **Voice similarity** (SSIM) ↑ | 0.938 | **0.951** | 0.941 | 0.935 |
+| **Dead air** (excess silence) ↓ | **0.029 s** | 0.386 s | 0.568 s | 0.215 s |
+| **RTF, CPU** ↓ | **0.50×** | 6.12× | 0.71× | 0.73× |
+| **Time to first audio, CPU** ↓ | **~70 ms** | ~34 s | ~6.1 s | ~5.1 s |
+| Size | **202 M** params, 0.86 GB fp32, CPU | 3.1 GB, GPU | 1.9 GB, GPU | 1.9 GB, GPU |
+
+**4× fewer word errors than the next-best system**, and the fastest of the four
+on CPU. The gap is much wider in latency than in throughput: the two XTTS
+fine-tunes also beat real time (0.71×) but need seconds to emit their first
+sample, while OmniVoice is 6× *slower* than real time. All three are sized and
+tuned for a GPU, and it shows.
+
+Full comparison tables, per-subset breakdowns, and CPU speed methodology:
+**[docs/BENCHMARKS.md](https://github.com/zeroweight-ai/ZeroTTS/blob/main/docs/BENCHMARKS.md)**
+
+### Speed — CPU
+
+RTF (realtime factor, wall-clock synthesis time ÷ output audio duration — lower
+is faster; below 1× is faster than real time) and time-to-first-audio, all
+measured **on CPU**, single request, 8 inference threads pinned to a dedicated
+core pool (no other synthesis running concurrently). Three Vietnamese samples —
+short (26 chars), medium (77 chars), long (227 chars) — each run 6 times with
+the first 2 (cold-cache) discarded; figures below are the mean of the
+remaining 4.
+
+| | **ZeroTTS** | OmniVoice | XTTS-v2-vietnamse | viXTTS |
+|---|:-:|:-:|:-:|:-:|
+| RTF — short | **0.51×** | 10.87× | 0.70× | 0.71× |
+| RTF — medium | **0.47×** | 4.82× | 0.70× | 0.70× |
+| RTF — long | **0.53×** | 2.67× | 0.71× | 0.78× |
+| TTFA — short | **53 ms** | 21.7 s | 4.02 s | 2.45 s |
+| TTFA — medium | **66 ms** | 28.9 s | 4.02 s | 3.72 s |
+| TTFA — long | **89 ms** | 52.3 s | 10.3 s | 9.22 s |
+
+ZeroTTS's time-to-first-audio comes from its real streaming path — first audio frame,
+not first full utterance. The three baselines have no working CPU streaming
+path, so their TTFA is the time to the complete utterance. 
+
+## Credits
+
+Speech codec: **[MOSS-Audio-Tokenizer-Nano](https://github.com/OpenMOSS/MOSS-Audio-Tokenizer)**
+by the OpenMOSS team, Apache-2.0. ZeroTTS bundles its ONNX **decoder** graphs in
+the weights repo so there is no external runtime dependency; see
+[NOTICE](NOTICE) and [LICENSES/](LICENSES/).
+
+```bibtex
+@misc{gong2026mossaudiotokenizerscalingaudiotokenizers,
+  title={MOSS-Audio-Tokenizer: Scaling Audio Tokenizers for Future Audio Foundation Models},
+  author={Yitian Gong and Kuangwei Chen and Zhaoye Fei and Xiaogui Yang and Ke Chen
+          and Yang Wang and Kexin Huang and Mingshu Chen and Ruixiao Li
+          and Qingyuan Cheng and Shimin Li and Xipeng Qiu},
+  year={2026}, eprint={2602.10934}, archivePrefix={arXiv}, primaryClass={cs.SD}
+}
+```
+
+Vietnamese text normalization adapts the expansion rules and abbreviation table
+of **[soe-vinorm](https://github.com/vinhdq842/soe-vinorm)** (MIT), reimplemented
+as pure stdlib regex so the inference path keeps its no-torch, no-download
+guarantee. See [NOTICE](NOTICE).
+
+Benchmark reference audio comes from
+[VIVOS](https://huggingface.co/datasets/AILAB-VNUHCM/vivos),
+[viVoice](https://huggingface.co/datasets/capleaf/viVoice),
+[phoaudiobook](https://huggingface.co/datasets/thivux/phoaudiobook) and
+[Emilia](https://huggingface.co/datasets/amphion/Emilia-Dataset).
+ASR scoring uses [PhoWhisper](https://huggingface.co/vinai/PhoWhisper-large) (VinAI).
+
+## License
+
+Code and weights: **MIT**. The bundled MOSS codec decoder is Apache-2.0.
+The ZeroBench-TTS *dataset* is CC-BY-NC-4.0 (it redistributes audio from the
+corpora above) — that applies to the benchmark, not to ZeroTTS.