Awesome TTS & Voice Generation Models
A curated list of open-source Text-to-Speech (TTS) and voice cloning models. Models are sorted by release date (newest first).
Table of Contents
- Text-to-Speech (TTS) Models
- Anything to Audio
- Audio Restoration & Enhancement
- Speech Recognition (ASR)
- Audio Codecs & Tokenizers
- Audio Transcription Models
- Additional Resources
Text-to-Speech (TTS) Models
TTS Quick Comparison
| Model | Voice Cloning | ASR | Languages | Streaming | License |
|---|---|---|---|---|---|
| AuK | ✅ | ❌ | — | — | ![MIT][license-mit] |
| AuK-Flash | ✅ | ❌ | — | — | ![MIT][license-mit] |
| rumik-oss 1 | ❌ | ❌ | 22 Indic languages + English | — | ![Other][license-other] |
| Irodori-TTS-v4.1-Anime | — | ❌ | Japanese | — | ![MIT][license-mit] |
| ICE-012 Audio | ✅ | ❌ | 590 | ✅ | ![CC BY-NC 4.0][license-cc-by-nc-4.0] |
| Coqui TTS Anonymizer | ✅ | ❌ | 16 | ✅ | ![MPL 2.0][license-mpl-2.0] |
| TontaubeV1 | ✅ | ❌ | 7 | ✅ | ![Other][license-other] |
| Breeze TTS 2 | ✅ | ❌ | 2 | ✅ | ![Other][license-other] |
| Sopro v2 Turbo | ✅ | ❌ | 4 | ✅ | ![Apache 2.0][license-apache-2.0] |
| CuteTTS | ✅ | ❌ | 5 | ✅ | ![Apache 2.0][license-apache-2.0] |
| Rynsan TTS | — | ❌ | Khasi, Garo, Pnar, English, Hindi | — | ![CC BY 4.0][license-cc-by-4.0] |
| Audio8 TTS Preview 0.1B | ✅ | ❌ | 8 | — | ![Other][license-other] |
| Kiseki-TTS | ❌ | ✅ | Japanese | — | ![MIT][license-mit] |
| FireRedTTS3 | ✅ | ❌ | 24 | — | ![Apache 2.0][license-apache-2.0] |
| Audio8-TTS-Preview-0.6b | ✅ | ❌ | Cantonese, Chinese, Dutch, English, French, German, Italian, Japanese, Korean, Polish, Spanish | ❌ | ![Apache 2.0][license-apache-2.0] |
| NeuTTS-2E | ❌ | ❌ | English | ✅ | ![Other][license-other] |
| Scylla's Band | ❌ | ❌ | en_us, en_gb, es, it | ✅ | ![Apache 2.0][license-apache-2.0] |
| sanoTTS | ❌ | ❌ | English, Nepali, Hindi, Vietnamese, Indonesian, Chinese | ❌ | ![Other][license-other] |
| FreyaTTS | ❌ | ❌ | Turkish | ❌ | ![Apache 2.0][license-apache-2.0] |
| Inflect-Nano-v2 | ❌ | ❌ | English | ❌ | ![Apache 2.0][license-apache-2.0] |
| Gepard | ✅ | ❌ | English, Spanish, Portuguese, Dutch | ✅ | ![Apache 2.0][license-apache-2.0] |
| Higgs Audio v3 TTS | ✅ | ❌ | 102 | ✅ | ![Research Only][license-research-only] |
| dots.tts | ✅ | ❌ | Multilingual | ❌ | ![Apache 2.0][license-apache-2.0] |
| Confucius4-TTS | ✅ | ❌ | 14 | ❌ | ![Apache 2.0][license-apache-2.0] |
| WavTTS | ✅ | ❌ | English, Chinese | ❌ | ![CC BY-NC 4.0][license-cc-by-nc-4.0] |
| MOSS-TTS | ✅ | ❌ | 31 | ✅ | ![Apache 2.0][license-apache-2.0] |
| VoxFlash-TTS | ✅ | ❌ | Chinese, English | ❌ | ![Apache 2.0][license-apache-2.0] |
| Miso TTS | ✅ | ❌ | English | ❌ | ![MIT][license-mit] |
| Raon-OpenTTS-1B | ✅ | ❌ | English | — | ![CC BY-NC 4.0][license-cc-by-nc-4.0] |
| OronTTS | ✅ | ❌ | Mongolian, Kazakh | ❌ | ![MIT][license-mit] |
| Supertonic 3 | ✅ | ❌ | 31 | ✅ | ![OpenRAIL-M][license-openrail-m] |
| Scenema Audio | ✅ | ❌ | English, German, French, Spanish, Italian, Portuguese, Japanese, Chinese, Korean, Russian, Arabic, Hindi, Swahili | ❌ | ![Other][license-other] |
| Dramabox | ✅ | ❌ | English | ❌ | ![Other][license-other] |
| Sarashina2.2-TTS | ✅ | ❌ | Japanese, English | ❌ | ![Research Only][license-research-only] |
| LongCat-AudioDiT | ✅ | ❌ | Chinese, English | ❌ | ![MIT][license-mit] |
| SILMA TTS | ✅ | ❌ | Arabic, English | — | ![Apache 2.0][license-apache-2.0] |
| Fish Audio S2 Pro | ✅ | ❌ | 80+ | ✅ | ![Research Only][license-research-only] |
| LongCat-Next | ✅ | ✅ | Chinese, English | ✅ | ![MIT][license-mit] |
| Voxtral-4B-TTS | ✅ | ❌ | 9 | ✅ | ![CC BY-NC 4.0][license-cc-by-nc-4.0] |
| Blue (Light Blue) TTS | ✅ | ❌ | Hebrew, English, Spanish, Italian, German | ❌ | ![MIT][license-mit] |
| KittenTTS | ✅ | ❌ | English, Multiple | ✅ | ![Apache 2.0][license-apache-2.0] |
| Ming-omni-tts | ✅ | ❌ | Chinese, English | ❌ | ![Apache 2.0][license-apache-2.0] |
| SoulX-Singer | ✅ | ❌ | Mandarin, English, Cantonese | ✅ | ![Apache 2.0][license-apache-2.0] |
| SoproTTS | ✅ | ❌ | English | ✅ | ![Apache 2.0][license-apache-2.0] |
| Qwen3-TTS | ✅ | ❌ | 10 | ✅ | ![Apache 2.0][license-apache-2.0] |
| TADA | ❌ | ❌ | English | ❌ | ![Other][license-other] |
| Irodori-TTS-500M-v2 | ✅ | ❌ | Japanese | ❌ | ![MIT][license-mit] |
| KugelAudio | ✅ | ❌ | 23 European languages | ✅ | ![MIT][license-mit] |
| LEMAS-TTS | ✅ | ❌ | 10 | ❌ | ![Apache 2.0][license-apache-2.0] |
| MioTTS-2.6B | ✅ | ❌ | English, Japanese | ✅ | ![LFM][license-lfm] |
| MOSS-TTS-Nano | ✅ | ❌ | 20 | ✅ | ![Apache 2.0][license-apache-2.0] |
| NeuTTS | ✅ | ❌ | English, Spanish, German, French | ✅ | ![Apache 2.0][license-apache-2.0] |
| OmniVoice | ✅ | ❌ | 600+ | ❌ | ![Apache 2.0][license-apache-2.0] |
| T5Gemma-TTS | ✅ | ❌ | English, Chinese, Japanese | ❌ | ![MIT][license-mit] |
| TinyTTS | ❌ | ❌ | English | ✅ | ![Apache 2.0][license-apache-2.0] |
| VoxCPM2 | ✅ | ❌ | 30 | ✅ | ![Apache 2.0][license-apache-2.0] |
| Soprano | ❌ | ❌ | English | ✅ | ![Apache 2.0][license-apache-2.0] |
| GLM-TTS | ✅ | ❌ | Chinese, English | ✅ | ![Apache 2.0][license-apache-2.0] |
| Echo-TTS | ✅ | ❌ | English | ❌ | ![MIT][license-mit] |
| VibeVoice-Realtime | ✅ | ❌ | Multilingual | ✅ | ![MIT][license-mit] |
| Fun-CosyVoice 3.0 | ✅ | ❌ | 9 + 18+ Chinese dialects | ✅ | ![Apache 2.0][license-apache-2.0] |
| LFM2-Audio-1.5B | ✅ | ✅ | English | ✅ | ![LFM][license-lfm] |
| Marvis-TTS | ✅ | ❌ | English, French, German | ✅ | ![Apache 2.0][license-apache-2.0] |
| IndexTTS2 | ✅ | ❌ | Chinese, English | ✅ | ![Apache 2.0][license-apache-2.0] |
| Maya1 | ✅ | ❌ | English | ✅ | ![Apache 2.0][license-apache-2.0] |
| Step-Audio-EditX | ✅ | ❌ | Mandarin, English, Sichuanese, Cantonese, Japanese, Korean | ✅ | ![Apache 2.0][license-apache-2.0] |
| KaniTTS | ❌ | ❌ | English, German, Chinese, Korean, Arabic, Spanish | ✅ | ![LFM][license-lfm] |
| VibeVoice-Finetuning | ❌ | ❌ | — | ❌ | ![MIT][license-mit] |
| VoxCPM | ✅ | ❌ | Chinese, English | ✅ | ![Apache 2.0][license-apache-2.0] |
| FireRedTTS2 | ✅ | ❌ | EN, ZH, JP, KO, FR, DE, RU | ✅ | ![Apache 2.0][license-apache-2.0] |
| Audio Flamingo 3 (AF3) / Audio Flamingo Next | ❌ | ✅ | Multi-lingual | ✅ | ![Apache 2.0][license-apache-2.0] |
| ZipVoice | — | — | Chinese, English | — | ![Apache 2.0][license-apache-2.0] |
| Fish Speech | ✅ | ❌ | 8 | ✅ | ![Apache 2.0][license-apache-2.0] |
| Chatterbox | ✅ | ❌ | 23+ | ❌ | ![MIT][license-mit] |
| Orpheus-TTS | ✅ | ❌ | Multilingual | ✅ | ![Apache 2.0][license-apache-2.0] |
| MegaTTS3 | ✅ | ❌ | Chinese, English | ✅ | ![Apache 2.0][license-apache-2.0] |
| Spark-TTS | ✅ | ❌ | Chinese, English | ✅ | ![Apache 2.0][license-apache-2.0] |
| Step-Audio | ✅ | ✅ | Chinese, English, Japanese | ✅ | ![Apache 2.0][license-apache-2.0] |
| Kokoro-82M | ✅ | ❌ | 8 | ✅ | ![Apache 2.0][license-apache-2.0] |
| KokoClone | ✅ | ❌ | 7 | ✅ | ![Apache 2.0][license-apache-2.0] |
| LuxTTS | ✅ | ❌ | - | ✅ | ![Apache 2.0][license-apache-2.0] |
| MiMo-Audio | ✅ | ✅ | Multi-lingual | ✅ | ![Apache 2.0][license-apache-2.0] |
| SoulX-Podcast | ✅ | ❌ | Mandarin, English, Cantonese, Sichuanese, Henanese | ✅ | ![Apache 2.0][license-apache-2.0] |
| VieNeu-TTS | ✅ | ❌ | Vietnamese | ✅ | ![Apache 2.0][license-apache-2.0] |
| Dia | ✅ | ❌ | English | ✅ | ![Apache 2.0][license-apache-2.0] |
| MeloTTS | ❌ | ❌ | English, Spanish, French, Chinese, Japanese, Korean | ❌ | ![MIT][license-mit] |
| Kimi-Audio | ✅ | ✅ | Multi-lingual | ✅ | ![MIT][license-mit] |
| ![Apache 2.0][license-apache-2.0] | |||||
| eSpeak-NG | ❌ | ❌ | 100+ | ✅ | ![Other][license-other] |
AuK
AuK
Description: AuK is a 1.5B foundation model from Tencent for speech generation and editing, trained on millions of hours of diverse audio data. Through a single natural-language instruction interface it unifies an unusually broad task set: zero-shot TTS (speak text in the reference voice) and instruct TTS (voice from a description alone, no reference), content editing (rewrite what is said; even lyric editing that preserves melody and voice), acoustic editing (pitch by semitones, speed, volume), paralinguistic editing (emotion, timbre, de-accent, nonverbal sounds, whisper conversion), and enhancement & separation (denoise/dereverberate, speech separation, music/vocal separation, target-speaker extraction). Architecture: a diffusion transformer with layer-fusion weights, conditioned by a Qwen2.5-Omni-3B MLLM encoder and a separate VAE (loaded at runtime). Day-0 SGLang-Omni serving support, Gradio and ComfyUI integrations, and a task Cookbook are provided. Released under MIT.
Release Date: September 9, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| License | ![MIT][license-mit] |
| Parameters | 1.5B |
| Architecture | diffusion transformer + layer fusion, Qwen2.5-Omni-3B MLLM encoder, separate VAE |
| Variants | AuK (this, base) + AuK-Flash (distilled, 4-step inference) |
| Editing | content, lyric, pitch, speed, volume, emotion, timbre, de-accent, nonverbal, whisper conversion |
| Enhancement Separation | speech enhancement, speech separation, music separation, target speaker extraction |
| Deployment | SGLang-Omni (day-0), Gradio, ComfyUI |
Features: Unifies generation and the full editing/enhancement/separation spectrum in one instruction-following model — most systems pick one lane (TTS, or editing, or separation); AuK does zero-shot + instruct TTS, lyric rewriting with melody preservation, emotion/timbre/de-accent/whisper paralinguistic edits, and source separation through the same natural-language interface. A diffusion transformer with layer fusion, distilled into a 4-step AuK-Flash variant for fast inference.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![arXiv][link-arxiv] ![Demo][link-demo]
Additional Tools:
| Tool | Type | Link |
|---|---|---|
| ComfyUI-AuK | ComfyUI node | ComfyUI-AuK |
· · · · · · · · · · · · · ·
AuK-Flash
AuK-Flash
Description: AuK-Flash is the distilled variant of AuK, Tencent's 1.5B foundation model for speech generation and editing, optimized for fast 4-step inference. It exposes the same natural-language instruction interface as the base model: zero-shot TTS (reference voice) and instruct TTS (voice description, no reference), content and lyric editing, pitch/speed/volume acoustic edits, emotion/timbre/de-accent/nonverbal/whisper paralinguistic edits, plus speech enhancement and speech/music/target-speaker separation. Architecture matches the base: diffusion transformer with layer-fusion weights, Qwen2.5-Omni-3B MLLM encoder, and a separate runtime-loaded VAE. Released under MIT.
Release Date: September 9, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| License | ![MIT][license-mit] |
| Parameters | 1.5B |
| Architecture | diffusion transformer + layer fusion (distilled to 4 inference steps), Qwen2.5-Omni-3B MLLM encoder, separate VAE |
| Base Model | tencent/AuK |
| Editing | content, lyric, pitch, speed, volume, emotion, timbre, de-accent, nonverbal, whisper conversion |
| Enhancement Separation | speech enhancement, speech separation, music separation, target speaker extraction |
| Deployment | SGLang-Omni, Gradio, ComfyUI |
Features: Distills the AuK foundation model's diffusion transformer down to 4 inference steps, making the full generate-and-edit capability set (including enhancement and separation) practical for interactive use — traded against the base model's maximum quality, with the two variants loadable side-by-side from the same codebase.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![arXiv][link-arxiv] ![Demo][link-demo]
· · · · · · · · · · · · · ·
rumik-oss 1
rumik-oss 1
Description: rumik-oss 1 is a 3B multilingual text-to-speech model from rumik ai, trained on fewer than 70,000 hours of speech while performing competitively with existing TTS models. It covers 22 Indic languages in their native scripts and romanized forms plus English, supporting both single-language and code-switched synthesis. Delivery is conditioned via tags (tone, accent, pace), with inline vocalization control (, , ). It extends CohereLabs/tiny-aya-fire with discrete speech tokens from the mimi codec: following the flattened codec-token formulation used in llama-mimi, text conditioning and audio generation share a single autoregressive sequence, predicting eight codebook tokens per frame before advancing, with the frozen mimi decoder reconstructing the 24 kHz waveform. The model ships with 4 fixed voices (Ira, Aisha, Siya, Zoya) that perform equally well across all 22 languages; there is no zero-shot voice cloning. Licensed under Cohere's CC-BY-NC-4.0 with acceptable-use addendum (research and non-commercial use only).
Release Date: September 6, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ❌ |
| Asr | ❌ |
| Languages | 22 Indic languages + English (native scripts and romanized; code-switching supported) |
| License | ![Other][license-other] |
| Parameters | 3B (3,381,533,697 BF16) |
| Architecture | CohereLabs/tiny-aya-fire backbone + flattened mimi codec tokens (8 codebooks/frame, llama-mimi formulation) |
| Audio Codec | kyutai/mimi (frozen decoder), 24 kHz output |
| Pronunciation | ✅ |
| Highlights | description-conditioned delivery ( tags), inline vocalizations (//) |
| Variants | rumik-oss-1 (post-trained), rumik-oss-1-base (speaker-conditioned pre-post-training) |
Features: Brings competitive multilingual TTS to 22 Indic languages with under 70k training hours, using a flattened mimi codec-token formulation (single autoregressive sequence for text conditioning + audio) on the tiny-aya-fire backbone. Code-switched synthesis, description-conditioned delivery, and inline vocalization tags are first-class capabilities, and its 4 voices perform equally well across all 22 languages — unusual, as most TTS voices are language-specific.
Links: ![HuggingFace][link-huggingface] ![Blog][link-blog] ![Demo][link-demo]
· · · · · · · · · · · · · ·
Irodori-TTS-v4.1-Anime
Irodori-TTS-v4.1-Anime
Description: Irodori-TTS-v4.1-Anime is a Japanese text-to-speech model fine-tuned from Aratako/Irodori-TTS-v4.1-Small using anime-style speech data. Because the base model's annotation pipeline is not publicly documented, the fine-tuning data was annotated independently — so caption conditioning and emoji controls may behave differently from the base model. The full-precision checkpoint (0.8B params, F32) ships at the repository root, with quantized variants (int8-weight-only, int8-dynamic, int4-weight-only, float8-weight-only, float8-dynamic) in subdirectories. It follows the base model's MIT License and ethical restrictions; inference uses the original Irodori-TTS repository.
Release Date: September 4, 2026
| Feature | Value |
|---|---|
| Voice Cloning | — |
| Asr | ❌ |
| Languages | Japanese |
| License | ![MIT][license-mit] |
| Parameters | ~0.8B (766,052,385 F32) |
| Architecture | Irodori-TTS (Aratako) fine-tune; caption-conditioned with emoji controls |
| Base Model | Aratako/Irodori-TTS-v4.1-Small |
| Variants | int8-weight-only, int8-dynamic, int4-weight-only, float8-weight-only, float8-dynamic |
Features: A community fine-tune that ports the Irodori-TTS line into the anime-voice domain using an independently built annotation pipeline (since the base model's is undocumented), and ships the result with five ready-made quantization variants (int4/int8/fp8) for efficient inference.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Demo][link-demo]
· · · · · · · · · · · · · ·
ICE-012 Audio
ICE-012 Audio
Description: ICE-012 Audio is a multilingual text-to-speech model from DarkPs (a FanuonAI organization) with streaming output and reference-based voice cloning. Its defining trait is breadth of language coverage — 590 language names/variants are accepted (name or 2–3-letter ID, with a language-agnostic fallback), including 13 Arabic dialects ("Lahgtna" variants) alongside the full ISO list. It introduces an active acoustic adapter — conditioning codec embeddings before the backbone and refining hidden states after it. Voice is controllable along six axes: gender (male/female), age (child → elderly), pitch (5 levels), accent (10 English accents), style (e.g. whisper), and speed (0.5–2.0×), plus an --auto-voice mode where the model picks a voice automatically. The checkpoint is ~714M parameters (F16) and runs via transformers with trust_remote_code=True. Released under CC BY-NC 4.0.
Release Date: August 29, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | 590 names/variants (incl. 13 Arabic Lahgtna dialects; language-agnostic fallback) |
| Streaming | ✅ |
| License | ![CC BY-NC 4.0][license-cc-by-nc-4.0] |
| Parameters | ~714M (714,409,993 F16) |
| Architecture | causal LM with active acoustic adapter (conditions codec embeddings pre-backbone, refines hidden states post-backbone) |
| Voice Controls | gender, age, pitch, accent, style, speed; auto-voice mode |
Features: The active acoustic adapter wraps the backbone on both sides — conditioning codec embeddings before it and refining hidden states after — while a six-axis voice-control space (gender/age/pitch/accent/style/speed plus auto-voice) and 590-language coverage make it one of the broadest single-checkpoint TTS releases for dialect and minority-language synthesis.
Links: ![HuggingFace][link-huggingface] ![Website][link-website] ![Demo][link-demo]
· · · · · · · · · · · · · ·
Coqui TTS Anonymizer
Coqui TTS Anonymizer (rm00cr/coqui-tts)
Description: Coqui TTS Anonymizer is a fork of Coqui TTS whose headline capability is a speaker-anonymization pipeline: give it a recording plus a donor voice, and it returns the same words spoken in the donor's voice. The transcript survives verbatim; the original speaker's vocal identity does not. The paper behind it (Your Voice Cloning System is Secretly a Voice Anonymizer, arXiv 2608.27360) makes the mechanism explicit — XTTS v2's voice cloning preserves prosodic structure independently of speaker identity, so the cloning path can be repurposed as voice conversion by conditioning on a pseudo-speaker, with no retraining. The fork adds an anonymizer/ package (pipeline, config, voice pools, donor selection, scoring, resumable batch, CLI), anonymization entry points on the Xtts class, and a weight-free unit-test suite. Evaluation covers seven European languages across CommonVoice and Multilingual LibriSpeech, reporting near-optimal privacy (EER ≈ 0.49) with substantially better speech quality than dedicated anonymization baselines and no language-specific training.
Release Date: August 27, 2026
| Feature | Value |
|---|---|
| Parameters | XTTS v2 checkpoints (~2 GB, downloaded once); no new weights trained |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | 16 (XTTS v2) |
| Streaming | ✅ |
| License | ![MPL 2.0][license-mpl-2.0] |
| Base Model | coqui-ai/TTS (XTTS v2) |
| Pipeline | Whisper transcript → tokenize → XTTS GPT with reference conditioning → HiFi-GAN decode at 24 kHz |
| Modes | single (one forward pass, seconds) / refine (segment + rescore + regenerate weak segments + crossfade stitch, minutes, GPU) / iterate (N compounding passes, keeps the best-scoring, minutes, GPU) |
| Donor Selection | explicit file, directory, or comma-separated list; or a voice pool (directory of per-speaker folders, or a CSV manifest) with most_distant selection |
| Selection Metric | ECAPA2 mean cosine similarity; the pool speaker furthest from the target wins, then conditioning on its select_top_k least-similar clips (default 10) |
| Selection Preview | anonymize select ranks the pool without loading XTTS |
| Scoring | WER, BLEU, target_similarity, reference_similarity, overall_quality (weighted 0.05 / 0.05 / 0.30 / 0.60) |
| Iterate Tradeoff | on the bundled sample, three iterations moved similarity-to-original 0.198 → 0.141 while WER rose 0.00 → 0.07 |
| Cli | anonymize run / anonymize batch / anonymize select / anonymize config |
| Batch | resumable, file-locked checkpoint, manifest.csv recording the chosen donor per file, per-file failure isolation |
| Config Precedence | CLI flag > --config file > environment variable > built-in default |
| Env Vars | XTTS_MODEL_DIR, ANONYMIZER_DEVICE, ANONYMIZER_MODE, ANONYMIZER_WHISPER_MODEL, ANONYMIZER_VOICE_POOL |
| Install | uv sync then uv run anonymize download-model |
| Api | from anonymizer import Anonymizer then anon.anonymize("interview.wav", reference="donor.wav") |
| Hardware | CUDA GPU strongly recommended; CPU is workable for single only |
| Limitations | transcript content is not redacted; language must be set explicitly; quality depends on the donor; Whisper errors propagate; prosody and timing shift; not a formal privacy guarantee |
| Upstream Models | ⓍTTS v2, VITS, YourTTS, Tortoise, Bark, ~1100 Fairseq models, plus the MelGAN / HiFi-GAN / UnivNet vocoder family |
Features: The paper's insight is a capability inversion: a voice cloning model is
a voice anonymizer in disguise. XTTS v2 was trained on 27k hours to keep
prosody and linguistic content while swapping speaker identity on demand —
which is precisely the operation anonymization needs, only with the
"speaker" axis pointed at a pseudo-speaker rather than a target identity.
Reframing it that way means zero retraining and zero language-specific
data, and it is why the released system is a ~300-line façade over an
existing checkpoint rather than a new model. Two engineering decisions make
it usable rather than merely clever. First, donor choice is automated and
per-utterance: a fixed donor is a weak default (if the donor resembles the
speaker being anonymized, almost no identity is removed), so the pool mode
embeds the target and every candidate with ECAPA2 and picks the speaker
furthest away, recording the choice in the batch manifest so a run stays
auditable. Second, quality is a knob with a measured cost: refine
resynthesizes only weak segments, while iterate compounds conversion — the
repo publishes the resulting similarity/WER trade-off rather than claiming a
free lunch. The honest framing of the limitation matters too: this hides
who is speaking, not what was said, and the authors are explicit that
empirical ECAPA2 similarity is not a formal privacy guarantee.
Links: ![GitHub][link-github] ![arXiv][link-arxiv] ![Predecessor][link-predecessor]
· · · · · · · · · · · · · ·
TontaubeV1
TontaubeV1
Description: TontaubeV1 is a multilingual text-to-speech model from TontaubeAI (craitech) designed for expressive voice cloning, long-form generation, and low-latency streaming. Its release contains four causal codebook predictors: CB0 generates semantic audio and duration from text, while progressively smaller CB1–CB3 add acoustic detail. CB0 uses a Qwen3-1.7B-derived transformer trunk and CB1–CB3 progressively shallower Qwen3-0.6B-derived trunks, each with a two-layer audio-token head. The four output streams are decoded with DualCodec, and the inference path uses VibeVoice's acoustic encoder/decoder for continuous reconstruction and streaming. It ships bundled synthetic voices plus zero-shot cloning from up to 60 s of reference audio, with public speaking styles audiobook, conversational, and agentic. Released under the Tontaube Community Model License 1.0, which is explicitly not open-source.
Release Date: August 26, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | 7 (English, German primary; Spanish, French, Italian, Dutch, Portuguese secondary) |
| Streaming | ✅ |
| License | ![Other][license-other] |
| Parameters | ~2.87B (2,873,962,498; CB0 1.83B + CB1 449M + CB2 327M + CB3 269M) |
| Architecture | 4-stage Qwen3-derived codebook cascade (CB0–CB3) + DualCodec + VibeVoice decode |
| Styles | audiobook, conversational, agentic |
Features: The four-stage codebook cascade (CB0 semantic+duration → CB1–CB3 progressive acoustic refinement) lets a single multilingual model deliver expressive, long-form, low-latency speech with strong zero-shot cloning. On the 1,088 English zero-shot Seed-TTS examples it posts 1.66% mean utterance-level WER (measured with Whisper large-v3 at semantic temperature 0.6), and the RTX-5090 streaming path reaches ~200 ms to first encoded audio.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Demo][link-demo] ![Paper][link-paper]
· · · · · · · · · · · · · ·
Breeze TTS 2
Breeze TTS 2
Description: Breeze TTS 2 is an open-weight text-to-speech model from BreezeBlue / RESONIA built for real-time interaction. It ranks #1 among open-weight models on the Artificial Analysis TTS leaderboard while outperforming frontier proprietary systems. Its open-ended natural-language instruction-following supports reference-free voice design (create a voice from a text description) and reference-guided voice direction (clone a voice while steering tone, emotion, pace, delivery), alongside standard reference-audio voice cloning. Ultra-low-latency streaming reaches 0.32 RTF (≈3.1× real time with the warmed-up fast path) and under 40 ms time-to-first-audio on an NVIDIA H100, emitting 24 kHz PCM. Source code is Apache-2.0; model weights are governed by the BreezeBlue Research and Non-Commercial License (commercial use needs written authorization from RESONIA).
Release Date: August 25, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | 2 (English, Chinese) |
| Streaming | ✅ |
| License | ![Other][license-other] |
| Parameters | 3B (3,466,363,713) |
| Architecture | seq2seq backbone + depth decoder + codec with CUDA-graph fast path (no named backbone disclosed) |
| Highlights | #1 open-weight on Artificial Analysis TTS leaderboard; vocal events inline (laugh/cough) |
Features: Pairs natural-language voice control with real-time streaming: a single model handles reference-free voice design (no reference audio needed) and voice direction (clone + steer prosody), and ships a CUDA-graph fast path that hits sub-40 ms TTFA at ~3.1× real time on H100 — open-weight quality that the authors claim exceeds frontier proprietary TTS.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Blog][link-blog] ![Demo][link-demo]
Additional Tools:
| Tool | Type | Link |
|---|---|---|
| ComfyUI-Breeze-TTS-2 | ComfyUI node | ComfyUI-Breeze-TTS-2 |
· · · · · · · · · · · · · ·
Sopro v2 Turbo
Sopro v2 Turbo
Description: Sopro (Portuguese for "breath") is a lightweight voice-cloning text-to-speech family. This repo ships sopro-v2-turbo, a 120M-parameter open model that streams and runs comfortably on a laptop CPU or in the browser (ONNX runtime), reaching SOTA-level intelligibility against much larger systems. It supports zero-shot voice cloning from 5–20 s of reference audio, four languages (English, European Portuguese, French, German), and a streaming path with ~300 ms time-to-first-audio on a laptop CPU (0.24 RTF offline / 0.21 RTF streaming on an M3 CPU, 0.07 RTF on H100). Released under Apache-2.0.
Release Date: August 25, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | 4 (English, European Portuguese, French, German) |
| Streaming | ✅ |
| License | ![Apache 2.0][license-apache-2.0] |
| Parameters | 120M (121,574,193) |
| Deployment | in-browser ONNX runtime; int8 AR weights on CPU; causal vocoder |
| Architecture | autoregressive TTS + chunked-attention streaming path + causal vocoder (F5-TTS/CosyVoice/Vocos lineage acknowledged) |
Features: Packs SOTA-level intelligibility into a 120M footprint that runs in the browser or on a laptop CPU, with a chunked-attention + causal-vocoder streaming path (~300 ms TTFA) — making zero-shot multilingual voice cloning practical for on-device and edge deployment rather than GPU-only serving.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Demo][link-demo] ![Blog][link-blog]
· · · · · · · · · · · · · ·
CuteTTS
CuteTTS
Description: CuteTTS is a lightweight (~230M-parameter) continuous autoregressive TTS model from OPPO that models continuous latents rather than discrete codec tokens, running efficiently on GPUs, CPUs, and Apple silicon. It delivers ultra-low latency — ~40 ms to the first audio chunk and ~9× real-time throughput on an RTX 4090 — with strong speech quality and zero-shot voice cloning (best-in-comparison 78.9 SIM on LibriSpeech test-clean). Multilingual support covers English, Chinese, French, German, and Spanish. A distilled variant (CuteTTS-distill) trades slight quality for further efficiency. Ships with a web demo, Python API, and CLI.
Release Date: August 24, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | 5 (English, Chinese, French, German, Spanish) |
| Streaming | ✅ |
| License | ![Apache 2.0][license-apache-2.0] |
| Parameters | ~230M |
| Architecture | continuous autoregressive modeling of latents + speaker encoder + audio VAE (discrete-codec-free design) |
| Variants | CuteTTS, CuteTTS-distill |
Features: Autoregressively models continuous latent audio representations instead of discrete codec tokens, eliminating codebook-related artifacts and quantization loss at only ~230M parameters. Combined with a lightweight speaker encoder and audio VAE, this yields best-of-class speaker similarity among compared open models and ~40 ms first-chunk latency while remaining practical for CPU/Apple-silicon inference.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![arXiv][link-arxiv]
· · · · · · · · · · · · · ·
Rynsan TTS
Rynsan TTS
Description: Rynsan TTS is a multilingual text-to-speech model that extends k2-fsa/OmniVoice to support Khasi, Garo, and Pnar — languages of Meghalaya, India that have historically had limited representation in modern speech technology. Rather than building a system from scratch, Rynsan retains the multilingual capabilities of the base model while adding speech data for these low-resource Khasic languages. Developed under the Tynrai AI initiative, its broader goal is accessible speech technology for the diverse languages and dialects of Meghalaya, supporting their preservation and use in voice-based applications. A live demo is available at ri.tynrai.in/demo. The repository is gated (manual access approval).
Release Date: August 22, 2026
| Feature | Value |
|---|---|
| Asr | ❌ |
| Languages | 5+ (English, Hindi + extension languages Khasi kha, Garo grt, Pnar pbv; base OmniVoice supports more) |
| License | ![CC BY 4.0][license-cc-by-4.0] |
| Parameters | ~0.61B |
| Architecture | OmniVoice (k2-fsa) multilingual TTS, extended fine-tune |
| Base Model | k2-fsa/OmniVoice |
| Developer | Toiar / Tynrai AI |
Features: Extends a modern multilingual TTS foundation to three substantially under-resourced Khasic languages — a rare production-oriented entry for indigenous-language speech tech, aimed at accessibility, education, and language preservation rather than benchmark leadership.
Links: ![HuggingFace][link-huggingface] ![Demo][link-demo]
· · · · · · · · · · · · · ·
Audio8 TTS Preview 0.1B
Audio8 TTS Preview 0.1B
Description: Audio8 TTS Preview 0.1B is the smallest release in the Audio8 TTS family ("the smallest zero-shot TTS worth running"): a ~170M-parameter generative model plus a separate ~120M-parameter codec decoder, making the complete audio generation stack much smaller than most modern multilingual TTS systems. It supports speech generation and zero-shot voice cloning (reference audio + matching transcript). Primary languages are Chinese and English, with German, Spanish, French, Italian, Japanese, and Korean as experimental/multilingual-evaluation targets. Released under the custom Audio8 Community License v1.0: non-commercial use is free, and commercial use is free only for entities with annual revenue under US$2M.
Release Date: August 19, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | 8 (Chinese + English primary; de/es/fr/it/ja/ko experimental) |
| License | ![Other][license-other] |
| Parameters | ~0.17B main model (+ ~120M codec decoder) |
| Architecture | Audio8 Falcon H1 DualAR — slow AR (semantic tokens) + fast AR (codec codebooks), 10 codebooks × 4096 entries |
| Audio Codec | bundled 44.1 kHz neural codec (~21.5 frames/s) |
| Context | up to 2,048 packed text/audio positions |
| Variants | 0.1B (this), 0.6B |
Features: Packs practical zero-shot cloning into a ~170M-parameter model using an Falcon-H1-derived DualAR design (slow AR predicts semantic tokens per frame; fast AR predicts the frame's 10 codebooks conditioned on the slow hidden state). On Seed-TTS it posts EN WER 1.662 at only ~0.17B — within reach of 4B+ systems — and ships with its own 44.1 kHz codec so no external codec checkpoint is needed.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github]
· · · · · · · · · · · · · ·
Kiseki-TTS
Kiseki-TTS
Description: Kiseki-TTS is a small, fast Japanese text-to-speech model from telecomadm1145 built on top of Qwen/Qwen3-TTS-Tokenizer-12Hz. It generates discrete neural audio codec tokens at 12.5 Hz (4–6× fewer autoregressive steps than 50–75 Hz codecs) and decodes them to waveform with the Qwen3 TTS codec. The acoustic decoder is a linear-time Mamba2 SSM rather than a self-attention stack, so generation cost is constant per frame — memory does not grow with utterance length and there is no KV cache to manage. Because TTS and ASR were trained jointly in a single multi-task run, the same checkpoint also performs ASR (Japanese speech → text, reading only codec layer 0). It is a single-domain voice (ASMR-style Japanese training data) with no speaker conditioning or voice cloning.
Release Date: August 15, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ❌ |
| Asr | ✅ |
| Languages | Japanese only (ja) |
| License | ![MIT][license-mit] |
| Parameters | ~0.41B (0.33B backbone + 78M audio branch) |
| Architecture | Transformer encoder (12 layers, bidirectional self-attention) + cross-attention → Mamba2 SSM decoder (6 layers, no causal self-attention) |
| Audio Codec | Qwen3-TTS-Tokenizer-12Hz (12.5 Hz, 16 quantizer layers) |
| Base Model | Kiseki-1.1-0.3B (seq2seq translation model) |
| Training Data | telecomadm1145/asmr_archive_qwentts_encoded |
Features: The decoder deliberately omits causal self-attention — temporal context is carried entirely by the Mamba2 recurrent state while text conditioning enters through cross-attention whose K/V are computed once during prefill. This yields O(1) state per frame (a fixed SSM tensor plus a 3-frame conv window) instead of an O(T) KV cache, so long-form synthesis degrades gracefully past the ~41 s training ceiling instead of hitting a memory cliff. Combined with the 12.5 Hz codec and a shared multi-token-prediction head that resolves all 16 codebook layers in one trunk pass, the model is both compute- and memory-bandwidth-bound rather than quadratic in length.
Links: ![HuggingFace][link-huggingface]
· · · · · · · · · · · · · ·
FireRedTTS3
FireRedTTS3
Description: FireRedTTS3 is a unified speech generation and editing system from the FireRed Team built on semantically enriched continuous speech representations. It ships in two variants: FireRedTTS3-Base (zero-shot voice cloning across 24 languages and 21 Chinese dialects) and FireRedTTS3-Instruct (natural-language voice design and combined semantic + acoustic speech editing in one model). Beyond cloning, it supports instruction-based voice design (no reference audio needed) and editing operations such as insertion / deletion / substitution (semantic) and speed / pitch / volume changes (acoustic).
Release Date: August 5, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | 24 (plus 21 Chinese dialects) |
| License | ![Apache 2.0][license-apache-2.0] |
| Architecture | Qwen3 backbone + patch-level diffusion autoregressive (DiTAR) + RedAE codec + CAM++ speaker encoder |
| Variants | Base (cloning), Instruct (cloning + voice design + editing) |
Features: Represents speech with semantically enriched continuous (non-quantized) representations, enabling a single system to do zero-shot cloning, text-driven voice design, and fine-grained semantic + acoustic editing. On Seed-TTS-eval it reaches an average WER/CER of 3.04% with 78.8% speaker similarity; MiniMax-MLS-Test average SIM 84.8%.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github]
Additional Tools:
| Tool | Type | Link |
|---|---|---|
| FireRedTTS3-ComfyUI | ComfyUI node | FireRedTTS3-ComfyUI |
· · · · · · · · · · · · · ·
Audio8-TTS-Preview-0.6b
Audio8-TTS-Preview-0.6b
Description: Audio8 TTS Preview 0.6B is a 0.6B-parameter multilingual text-to-speech model with zero-shot voice cloning. It uses a DualAR architecture inspired by Fish Audio S2 Pro: a slow AR transformer predicts one semantic token per audio frame, and a fast AR transformer predicts the frame's codec codebooks conditioned on the slow hidden state and preceding codebooks. The bundled 44.1 kHz neural audio codec handles both reference-audio encoding and waveform decoding — no additional codec checkpoint is required. The model supports 11 recommended languages (Cantonese, Chinese, Dutch, English, French, German, Italian, Japanese, Korean, Polish, Spanish) with zero-shot voice cloning from a reference audio clip + matching transcript.
Release Date: July 28, 2026
| Feature | Value |
|---|---|
| Parameters | 601,159,424 (0.6B, excluding the codec) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | Cantonese, Chinese, Dutch, English, French, German, Italian, Japanese, Korean, Polish, Spanish (11) |
| Streaming | ❌ |
| License | ![Apache 2.0][license-apache-2.0] |
| Architecture | DualAR (slow AR + fast AR), inspired by Fish Audio S2 Pro |
| Slow Ar | 24 layers, width 896, 14 attention heads, 2 KV heads |
| Fast Ar | 4 layers, width 896, 14 attention heads, 2 KV heads |
| Acoustic Tokens | 10 codebooks, 4,096 entries per codebook |
| Codec | 44.1 kHz, 2,048 samples per model frame (~21.5 frames/s), bundled (no external codec needed) |
| Context Length | up to 2,048 packed text/audio positions |
| Sample Rate | 44,100 Hz |
| Inference | transformers with trust_remote_code=True; CUDA-capable GPU recommended |
| Dependencies | torch>=2.5.0, torchaudio>=2.5.0, transformers>=4.57.0,<5, soundfile, safetensors |
| Preview Status | language coverage intentionally limited; broader multilingual + Chinese dialect support planned |
| Library Name | transformers (custom_code) |
| Pipeline Tag | text-to-speech |
| Createdat | 2026-07-28T07:53:00Z |
Features: The DualAR architecture is the technical centerpiece: rather than a single autoregressive decoder predicting all codebook levels sequentially (the standard codec-LLM TTS pattern), Audio8 splits the work into a slow AR that predicts one semantic token per audio frame and a fast AR that predicts the frame's remaining codec codebooks conditioned on the slow hidden state. This separation lets the semantic-level reasoning happen at the slow AR's 24-layer depth while the acoustic codebook prediction stays lightweight at 4 layers — reducing the total compute per frame without sacrificing semantic quality. The bundled 44.1 kHz codec (no external codec checkpoint needed) and the 10-codebook / 4,096-entry acoustic token design give the model self-contained high-fidelity output at a compact 0.6B scale, making it one of the smallest multilingual zero-shot-cloning TTS systems shipping at 44.1 kHz.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Website][link-website]
· · · · · · · · · · · · · ·
NeuTTS-2E
NeuTTS-2E
Description: NeuTTS-2E is a super-fast, highly realistic, on-device emotional text-to-speech model from Neuphonic. It is the next generation after NeuTTS Air / Nano (which continue to ship for multilingual + zero-shot-cloning contexts) — narrowed in scope to an English-only alpha focused on:
Release Date: July 21, 2026
| Feature | Value |
|---|---|
| Parameters | 0.2B (compact LM backbone + codec) |
| Voice Cloning | ❌ |
| Asr | ❌ |
| Languages | English (English-only alpha) |
| Streaming | ✅ |
| License | ![Other][license-other] |
| Backbone | compact LM backbone tuned for emotional TTS token generation |
| Codec | efficient codec (compact, paired with the LM) |
| Speakers | 4 fixed (emily, paul, sophie, steven) |
| Emotions | 6 + neutral (angry, disgusted, fearful, happy, sad, surprised, neutral) |
| Emotion Control Mode | single-argument selection (no composable multi-axis axes like Scylla's Band) |
| Input Format | text only — no phonemizer, no system dependencies |
| On Device | yes (laptop-class CPU real-time / better-than-real-time) |
| Distribution Formats | safetensors (torch), Q4 GGUF, Q8 GGUF |
| Formats In Collection | neuphonic/neutts-2e (safetensors), neuphonic/neutts-2e-q4-gguf (smallest footprint), neuphonic/neutts-2e-q8-gguf (mid-tier compression) |
| Gguf Features | imatrix, conversational, endpoints_compatible |
| Pipeline Tag | text-to-speech |
| Library Name | (HF tag does not declare transformers / safetensors stem beyond safetensors itself) |
| Downloads | 194 / 241 / 216 (torch / q4 / q8) |
| Intended Use | embedded voice agents, on-device assistants, toys, privacy-sensitive applications |
| Comparison With Air Nano | Air/Nano continue to ship for zero-shot cloning + multilingual contexts; 2E is the next-gen focused English emotional variant |
| Safety Note | model is alpha; legitimate project landing is neuphonic.com (not neutts.com) |
Features: The technical center of NeuTTS-2E is maximum speed per parameter
at on-device budgets — the 0.2B LM + codec pair delivers
real-time-or-better on laptop-class CPUs while exposing
discrete categorical emotion control (angry / disgusted /
fearful / happy / sad / surprised / neutral) plus a
fixed four-speaker cast for consistency in agent / toy /
accessibility voice personas. Two design choices distinguish it from
the surrounding TTS field:
First, the categorical emotion surface is single-axis and
discrete (one emotion per call), not the continuous multi-axis
composable vector surface used by models like Scylla's Band
([neurotica base + 6-axis continuous strengths]). The project's
positioning — production-grade agents + toys + accessibility —
benefits from a one-argument API where emotion="happy" is the
explicit operational state. The release locks emotional mode at
generation time, which simplifies downstream filtering / guardrails.
Second, the distribution-shape design (one model, three
deployment formats) is a deliberate on-device-first posture: the
safetensors torch build for max-quality GPU/server; Q8 GGUF for
mid-tier compression; Q4 GGUF for the small-footprint embedded
target. All three are direct llama.cpp-compatible drops of the
same model — no retraining-per-format — letting users pick size vs
quality at deployment time without changing the production API.
The combined CPU-first + GGUF-first design pattern is the
opposite of the cloud-first TTS systems in this list — and is what
makes 2E suitable for embedded voice agents, toys, and
privacy-sensitive applications where audio + text must remain
on-device.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Demo][link-demo] ![Collection][link-collection]
· · · · · · · · · · · · · ·
Scylla's Band
Scylla's Band
Description: Scylla's Band is a multilingual, multi-voice, expressive TTS model from Spybyscript, designed specifically for local and self-hosted inference through ONNX Runtime (with an experimental LiteRT backend for explicit native / mobile use). The architecture is a continuous-latent TTS family:
Release Date: July 19, 2026
| Feature | Value |
|---|---|
| Parameters | not stated (architecture: 4-layer duration predictor (192 hidden) + 12-layer rectified-flow acoustic generator (512 hidden, AdaLN, QK norm)) |
| Voice Cloning | ❌ |
| Asr | ❌ |
| Languages | en_us, en_gb, es, it (4 public text-input languages) |
| Streaming | ✅ |
| License | ![Apache 2.0][license-apache-2.0] |
| Sample Rate | 24,000 Hz |
| Managed Voices | 10 (ariadne, felix, gwen, ink, max, orpheus, rex, scylla, stone, tuesday) |
| Voice Default Locale | en_us for most; ink / orpheus / tuesday default to en_gb |
| Voice Style Dim | 128 (style features) + 32 (prosody features) |
| Affect Axes | 6 (calm, joy, anger, sadness, sarcasm, questioning — all continuous in [0, 1]) |
| Affect Overlay Axes | sarcasm, questioning (mixable with any core delivery) |
| Affect Cfg Scope | duration + acoustic-flow prediction (preserves voice / reference) |
| Encoders Default | ONNX Runtime (Python CLI / Python API / Android sample / libscyllasband native) |
| Encoders Experimental | LiteRT (experimental / explicit-selection) |
| Cli Quality Default | 8-step Heun sampling |
| Graph Budgets | 512 G2P text tokens / 512 phone frames / 640 latent frames |
| Latent Target Buckets | 256 / 384 / 512 / 640 (smallest-fit selection) |
| Vocoder | Scylla's Band acoustic adapter + frozen charactr/vocos-mel-24khz |
| Hop Lengths | 256 (waveform) / 512 (latent) |
| Text Frontend | phrase-level multilingual G2P (74-phone vocabulary) |
| Span Context | 3 segments over up to 768 phones with 512-dim context state |
| Prefix Context | up to 24 acoustic latent frames from preceding chunk |
| Long Form Features | boundary metadata + punctuation pause floors + prefix-latent carryover + span context |
| Group Speak Input | [voice], [voice:language], [voice:language:axis=value,...] annotations |
| Bundle Contract | 1.0.0 / scyllasband-duration-flow |
| Intended Use | single-voice speech synthesis (10 voices); en/es/it; long-form narration; multi-voice dialogue from tagged text; continuous affect control; ONNX desktop/server; ONNX + LiteRT native/mobile |
| Not Intended | arbitrary-speaker cloning / impersonation / fraud / deceptive speech |
| Distributions | training data, trainer checkpoints, and export tooling not distributed |
| Cli Commands | download, validate-bundle, list-voices, normalize-text, speak, group-speak, stream, plan |
| Library Name | onnxruntime (tags include onnx, tflite, litert, duration-flow) |
Features: Three design decisions distinguish Scylla's Band in the multilingual
TTS class. First, decoupling duration and acoustic flow as
separate rectified-flow stages — duration is a 192-hidden, 4-layer
predictor operating on a 512-phone window, acoustic latents a
512-hidden, 12-layer AdaLN / QK-norm generator at 24-dim. This split
lets affect-CFG act on both stages independently while retaining
voice / reference conditioning, supporting the 6-axis continuous
composability. Second, 6 affect axes (with sarcasm and
questioning as overlays mixed with any core delivery) instead of
mutually-exclusive discrete emotion classes — calm=0.5, joy=0.5 is
a valid input, and axes stay in [0, 1] so multi-axis states are
expressible without combinatorial blow-up. Third, the ONNX-first
runtime design with libscyllasband native + an experimental
LiteRT backend sits at a budget most neural TTS systems don't
target — the 8-step Heun default and 512/512/640 fixed graph budget
keep the model usable on CPU and mobile, and the inference-only
release surface (training data + checkpoints not distributed) is the
complement of the latency / mobile inference focus.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Website][link-website]
· · · · · · · · · · · · · ·
sanoTTS
sanoTTS
Description: sanoTTS is the smallest known neural text-to-speech family. The name sano (सानो) is Nepali for "small". Each voice weighs 294k to 2.3M parameters — smaller than the smallest voice in prior families (TinyTTS at 1.62M; Inflect Nano at 4.63M; Kokoro at 82M) and the family fits in under 4 MB per voice with zero runtime dependencies (the espeak-ng phonemizer is bundled). Voices run real-time on a ~$3 ESP32-S3 microcontroller (output through a GPIO into an LM386 and a speaker) and live in the browser via WebAssembly — no server, no upload, no NPU. The full neural stack is duration → acoustic → decoder, quantized to int8, with the espeak-ng phonemizer included. 11 voices across 6 languages ship: English, Nepali, Hindi, Vietnamese, Indonesian, and Chinese — including the 294k heart-nano voice (337 KB) and the mel-based heart / heart-nano pair that predicts a 100-band spectrogram rendered by a noise-fed ConvNeXt + iSTFT decoder at 24 kHz. The inference runtime was relicensed MIT (September 2026); the project as a whole remains GPLv3 via espeak-ng. The project page at ampixa.github.io/sanoTTS hosts a live browser synthesis demo for every voice.
Release Date: July 13, 2026
| Feature | Value |
|---|---|
| Parameters | 294k–2.3M per voice (smallest = the 294k "heart-nano" voice, 337 KB) |
| Voice Cloning | ❌ |
| Asr | ❌ |
| Languages | English, Nepali, Hindi, Vietnamese, Indonesian, Chinese (6 languages, 11 voices) |
| Streaming | ❌ |
| License | ![Other][license-other] |
| Architecture | full neural stack — duration model → acoustic model → decoder |
| Quantization | int8 (W8/A12, corr 0.9995+; piperlite portable C99) |
| Runtime Microcontroller | ESP32-S3 (real-time RTF 0.41, GPIO → LM386 → speaker) |
| Runtime Browser | WebAssembly (no server, no upload, no NPU) |
| Runtime Footprint | under 4 MB per voice, zero dependencies |
| Voices | 11 (English: amy / kristin / hfc / amy-1p1m / amy-1p8m / robot / heart / heart-nano; one voice each for NE / VI / ID / ZH + shared lang voices) |
| Phonemizer | espeak-ng (bundled) |
| License Split | inference runtime MIT; project overall GPL-3.0 (copyleft from espeak-ng) |
| Library Name | sanotts |
| Training Method | distillation (per voice) |
Features: The hard constraint — be the smallest neural TTS family known,
real-time on a $3 microcontroller — drives the entire stack.
Conventional sub-100M TTS systems are too large for an ESP32's flash
and RAM. sanoTTS keeps the full duration → acoustic → decoder
neural pipeline (no espeak-NG-only fallback, no concatenative
hybrid), quantizes everything to int8, and bundles the phonemizer
so the whole voice ships in under 4 MB with zero runtime dependencies.
The newest heart / heart-nano voices switch to a mel-based recipe
(100-band spectrogram + noise-fed ConvNeXt + iSTFT decoder at 24 kHz),
bringing the smallest voice down to 294k parameters / 337 KB —
a per-voice footprint 100× smaller than Kokoro and 2× smaller than
TinyTTS while still leading SCOREQ / UTMOS in the sub-15M class —
and the demo synthesizes every voice live in the browser via
WASM, so the smallest-known neural TTS is also the only one that
runs unattended on a $3 chip and a $0 web page.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Website][link-website]
· · · · · · · · · · · · · ·
FreyaTTS
FreyaTTS
Description: FreyaTTS is a 183M-parameter Turkish text-to-speech model. It is tokenizer-free at the character level — 92 symbols in its Turkish vocabulary — so there is no phonemizer or G2P step in either training or inference. Speech is generated with a non-autoregressive conditional flow-matching DiT in the frozen AudioVAE2 latent space (25 Hz, 64-dim latents, 16 kHz encode / 48 kHz decode). Training runs from scratch on Turkish speech: a pretraining stage followed by SFT stage 1/2 for voice lock and short-utterance coverage. Output is 48 kHz mono. On the project's Freya-TR-Eval benchmark the model reports WER 8.0% / CER 3.0%, ranking 3rd of 7 among open sub-1B Turkish TTS systems — a deliberate single-target-speaker, no-cloning design choice for a focused foundation release. The evaluation dataset is freya-tr-eval.
Release Date: July 7, 2026
| Feature | Value |
|---|---|
| Parameters | 183.2M |
| Voice Cloning | ❌ |
| Asr | ❌ |
| Languages | Turkish (tr) |
| Streaming | ❌ |
| License | ![Apache 2.0][license-apache-2.0] |
| Architecture | conditional flow-matching diffusion transformer (DiT), non-autoregressive, 32-step Euler ODE, no CFG |
| Tokenizer | character-level (92 Turkish symbols; no phonemizer, no G2P) |
| Latent Space | frozen AudioVAE2 (Apache-2.0, openbmb/VoxCPM2), 64-dim at 25 Hz |
| Codec Io | 16 kHz encode / 48 kHz decode |
| Sample Rate | 48,000 Hz |
| Training | from scratch on Turkish speech; pretraining + SFT stage 1/2 (voice lock + short-utterance coverage) |
| Evaluation | Freya-TR-Eval — WER 8.0% / CER 3.0%, 3rd of 7 open sub-1B Turkish TTS |
| Library Name | freyatts |
Features: Two design choices are worth flagging. First, tokenizer-free character-level Turkish: by training directly on the 92-symbol Turkish alphabet with no phonemizer or G2P grapheme-to-phoneme step, the model removes a dependency that is fragile for agglutinative Turkish morphology and that often degrades quality when ported to low-resource Turkic relatives. Second, non-autoregressive conditional flow-matching in a frozen AudioVAE2 latent space: the 25 Hz / 64-dim bottleneck keeps the DiT small (183M) while inheriting a separately-trained audio codec's representation, letting a focused single-language-non-multilingual release ship at a fraction of the parameter budget of multilingual foundation TTS systems. The deliberate "no cloning, single target speaker" choice is a scope-lowering move that lets the foundation release put all its capacity into Turkish speech quality rather than spread it across zero-shot speaker adaptation.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Paper][link-paper]
· · · · · · · · · · · · · ·
Inflect-Nano-v2
Inflect-Nano-v2
Description: Inflect-Nano-v2 is a complete local text-to-waveform speech synthesis model with 3,966,721 deployable parameters — under 4M total. It is a VITS-architecture fixed-voice English TTS designed for CPU or CUDA inference with deterministic seeds, long-text handling, and 24 kHz mono output. The full FP32 checkpoint is 15.97 MB, making it one of the smallest complete neural TTS systems that produces natural-sounding speech without a separate vocoder or phonemizer dependency. The model ships with a public adaptation toolkit for preparing data, auditing train/validation splits, adapting a fixed voice or language, resuming training, evaluating checkpoints, and exporting PyTorch or ONNX packages. A sibling Inflect-Micro-v2 (9.36M parameters) prioritizes quality below 10M; Nano prioritizes footprint below 4M. Both share one public API.
Release Date: June 25, 2026
| Feature | Value |
|---|---|
| Parameters | 3,966,721 (3.97M deployable) |
| Voice Cloning | ❌ |
| Asr | ❌ |
| Languages | English |
| Streaming | ❌ |
| License | ![Apache 2.0][license-apache-2.0] |
| Architecture | VITS (end-to-end text-to-waveform) |
| Sample Rate | 24,000 Hz |
| Footprint | 15.97 MB FP32 |
| Inference | CPU or CUDA; PyTorch + ONNX export |
| Determinism | deterministic seeds for reproducible generation |
| Long Text | automatic text splitting and handling |
| Input Format | text (no phonemizer or system dependencies) |
| Adaptation Toolkit | data prep, split auditing, voice/language adaptation, training resume, checkpoint eval, PyTorch/ONNX export |
| Sibling Model | Inflect-Micro-v2 (9.36M params, quality-prioritized below 10M) |
| Api | one public API across Micro and Nano sizes |
| Library | pytorch |
| Metrics | WER |
| Inference False On Hf | yes (no hosted HF inference endpoint; local-only) |
Features: Inflect-Nano-v2's defining constraint is completeness under 4M parameters: the entire text-to-waveform pipeline — no separate vocoder, no phonemizer, no system dependencies — fits in 3.97M deployable parameters and a 15.97 MB FP32 checkpoint. This is smaller than even sanoTTS's smallest voice (745k) when measured by complete-pipeline footprint, though sanoTTS ships per-voice weights rather than a single fixed-voice checkpoint. The VITS end-to-end architecture is the enabler: by folding the acoustic model and vocoder into a single jointly-trained network, Inflect avoids the multi-stage pipeline overhead that makes most neural TTS systems larger. The public adaptation toolkit extends the fixed-voice design into a customizable platform — users can prepare data, adapt a voice or language, resume training, and export PyTorch or ONNX packages — making the 4M-parameter footprint a starting point for domain-specific TTS rather than a dead-end fixed-voice release.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Demo][link-demo]
· · · · · · · · · · · · · ·
Gepard
Gepard
Description: GEnerative, Prosody-aware, Autoregressive text-to-speech model for Realtime Dialogue. Gepard is built for low-latency, high-throughput streaming conversation: the model starts speaking the moment text begins arriving, generating audio piece by piece instead of waiting for a full sentence. It is a single decoder-only autoregressive language model built on Qwen3.5 (14 layers, hidden 1024, 8 heads) with ≈556M total parameters (backbone + audio interface + voice-cloning compressor). Audio is produced through NVIDIA NeMo NanoCodec — Finite Scalar Quantization at 22.05 kHz, 21.5 frames/s, 1.89 kbps — with the full 32-channel FSQ frame sampled in one step. Reports ~25× real time on a single RTX 5090 with first-audio-chunk latency around 50 ms; a 96 GB Blackwell card serves up to 256 concurrent conversations. CFG refinement is baked into the weights so quality gain comes at no extra two-pass cost at inference, though the two-pass mode is still selectable as a quality dial.
Release Date: June 22, 2026
| Feature | Value |
|---|---|
| Parameters | ~556M (555,694,169; Qwen3.5 backbone + audio interface + voice-cloning compressor) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ✅ |
| Emotion Control | ❌ |
| Languages | English (US/UK), Spanish (es-MX), Portuguese (pt-BR), Dutch (NL) |
| Streaming | ✅ |
| License | ![Apache 2.0][license-apache-2.0] |
| Audio Codec | NVIDIA NeMo NanoCodec (FSQ, 22.05 kHz, 21.5 fps, 1.89 kbps; NVIDIA Open Model License) |
| Sample Rate | 22,050 Hz |
| Backbone | Qwen3.5 full-attention transformer (14 layers, hidden 1024, 8 heads; ~500M params) |
| Inference | vLLM |
| Throughput | 256 conversations on one 96 GB Blackwell (RTX Pro 6000) GPU |
| Benchmark | Seed-TTS-eval leader on perceived quality (NISQA-MOS 4.25, NOI 4.16, COL 4.16, DIS 4.51) trading some WER/SIM |
Features: A prosody-aware autoregressive single-pass frame generator: the whole 32-channel FSQ audio frame is sampled in one step (no depth transformer), and CFG quality refinement is baked into the weights rather than incurred at inference as a two-pass cost — so the publicly reported TTFA of ~50 ms and 25× real time on a single RTX 5090 represent the quality-on path, not a cheap-fast preview. Voice cloning is decoupled into a separate up-front compressor, which means cloning is "free" at run-time once the reference clip is encoded — a structural choice that supports serving hundreds of conversations per GPU. A stop-head weight update (2026-08-06) fixed premature stopping at sentence boundaries and lifted the effective duration ceiling; on Seed-TTS-eval Gepard leads the compared systems on perceived quality (NISQA-MOS 4.25) while trading some speaker similarity and WER for its streaming-first design.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![arXiv][link-arxiv] ![Demo][link-demo] ![Paper][link-paper] ![Website][link-website]
· · · · · · · · · · · · · ·
Higgs Audio v3 TTS
Higgs Audio v3 TTS
Description: Boson AI's flagship conversational TTS: an ~4B autoregressive decoder over interleaved text and audio tokens from the Higgs Tokenizer (8 codebooks at 25 fps / 24 kHz). Built for voice chat rather than narration, it covers 102 languages with zero-shot voice cloning and inline control over emotion, style, prosody, pauses, and sound effects.
Release Date: June 4, 2026
| Feature | Value |
|---|---|
| Parameters | 4B (BF16, 36 layers, hidden=2560, GQA 32/8) |
| Architecture | Autoregressive decoder (Qwen3-style) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ✅ |
| Emotion Control | ✅ |
| Languages | 102 (85 with WER/CER <5, 17 between 5-10) |
| Streaming | ✅ |
| Audio Output | 24 kHz |
| License | ![Research Only][license-research-only] |
Features: Interleaved text/audio token modelling with a delay-pattern multi-codebook embedding/head: a single autoregressive stack emits both modalities and supports inline <|category:value|> control tags (emotion/style/sfx/prosody) inserted at any point in the target text.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Blog][link-blog] ![Demo][link-demo]
· · · · · · · · · · · · · ·
dots.tts
dots.tts
Description: dots.tts is a 2B-parameter fully continuous, end-to-end autoregressive TTS system from Rednote-HiLab. The backbone pairs a semantic encoder, an LLM, and an autoregressive flow-matching acoustic head over a 48 kHz AudioVAE, with no discrete tokens anywhere in the pipeline. It achieves the best average performance on Seed-TTS-Eval (WER 0.94 / 1.30 / 6.60 on zh / en / zh-hard) and the highest speaker similarity on a 24-language MiniMax multilingual benchmark, with broad cross-lingual voice cloning.
Release Date: June 3, 2026
| Feature | Value |
|---|---|
| Parameters | 2B (semantic encoder + LLM + AR flow-matching acoustic head) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | Multilingual (24+ languages; zh / en focus) |
| Streaming | ❌ |
| License | ![Apache 2.0][license-apache-2.0] |
| Sample Rate | 48 kHz |
| Tokenizer | 48 kHz AudioVAE (continuous, no discrete tokens) |
Features: A fully continuous autoregressive pipeline that keeps generation in waveform-latent space end-to-end (no discrete-code phase), pairing an LLM-side semantic encoder with an autoregressive flow-matching acoustic head over a 48 kHz AudioVAE — yielding SOTA seed-TTS-Eval scores and the strongest speaker-similarity number (83.9 avg) on the 24-language MiniMax multilingual benchmark.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Website][link-website] ![Demo][link-demo]
· · · · · · · · · · · · · ·
Confucius4-TTS
Confucius4-TTS
Description: Confucius4-TTS is an LLM-based text-to-speech system from NetEase Youdao designed for multilingual and cross-lingual synthesis. It uses a speech encoder + LLM (Text2Semantic) + flow-matching Semantic2Acoustic architecture that allows zero-shot voice cloning without a required reference transcript and explicit cross-lingual voice transfer with unaccented output across languages. Covers Chinese, English, Japanese, Korean, German, French, Spanish, Indonesian, Italian, Thai, Portuguese, Russian, Malay, and Vietnamese with code-switching and emotion transfer.
Release Date: June 2, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Emotion Control | ✅ |
| Languages | 14 (zh, en, ja, ko, de, fr, es, id, vi, th, pt, it, ru, ms) |
| Streaming | ❌ |
| License | ![Apache 2.0][license-apache-2.0] |
| Architecture | speech encoder + LLM (T2S) + flow-matching head (S2A) |
Features: Cross-lingual voice transfer without accent drift: the same reference voice stays consistent when the speaker switches languages — backed by a speech encoder + LLM backbone pipeline (T2S) with a flow-matching acoustic decoder (S2A) and training that bundles 14 languages with code-switched, emotion-preserving decoding.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Demo][link-demo]
· · · · · · · · · · · · · ·
WavTTS
WavTTS
Description: WavTTS is an end-to-end zero-shot TTS framework that synthesizes speech directly in the raw waveform space — explicitly skipping the intermediate mel-spectrogram, VAE-latent, or codec-token representations that most modern TTS stacks use. It is built on a flow-matching diffusion transformer (DiT) with waveform patchification, multi-scale mel-spectrogram supervision, and an optimized noise schedule. Forked from F5-TTS at the codebase level but replaces the whole acoustic pipeline.
Release Date: May 28, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | English, Chinese |
| Streaming | ❌ |
| License | ![CC BY-NC 4.0][license-cc-by-nc-4.0] |
| ![MIT][license-mit] | |
| Sample Rate | 16 kHz |
| Training Data | Emilia |
| Architecture | Flow-matching DiT, raw waveform patchification, multi-scale mel supervision |
| Training Steps | 1.2M |
Features: Skip every intermediate waveform representation (no mel, no VAE, no codec tokens): a flow-matching DiT produces raw-waveform patches directly, supervised at multiple mel scales and an optimized noise schedule — yielding high-quality zero-shot TTS at 16 kHz from a single end-to-end stack.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Demo][link-demo] ![Paper][link-paper]
· · · · · · · · · · · · · ·
MOSS-TTS
MOSS-TTS
Description: MOSS-TTS is a production-grade Text-to-Speech foundation model developed by the OpenMOSS Team and MOSI.AI. The current public v1.5 release preserves the original 1.0 capabilities — zero-shot voice cloning, long-form speech generation, token-level duration control, Pinyin/IPA pronunciation supervision, multilingual synthesis, and code-switching — and extends multilingual continued training from 20 languages to 31 languages including Cantonese, Dutch, Finnish, Hindi, Macedonian, Malay, Romanian, Swahili, Tagalog, Thai, and Vietnamese. v1.5 improves speaker similarity, reduces cloning variance on long-reference / short-text scenarios, follows punctuation-driven prosody more reliably, and adds explicit inline pause markers (e.g., [pause 3.2s]).
Release Date: May 25, 2026
| Feature | Value |
|---|---|
| Parameters | 8B (Delay), 1.7B (Local) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ✅ |
| Emotion Control | ✅ |
| Languages | 31 (extended from v1.0's 20) |
| Streaming | ✅ |
| License | ![Apache 2.0][license-apache-2.0] |
| Max Duration | 1 hour |
| Pause Control | yes (inline markers like [pause 3.2s]) |
| Lang Tag Control | yes (set language= in user message) |
Features: v1.5 widens MOSS-TTS from 20 → 31 languages with stronger per-language multilingual synthesis (control via a language tag in the user message), more stable cloning under long-reference / short-text conditions, punctuation-driven prosody that holds up across long sentences, and explicit inline pause tokens ([pause 3.2s]) for scripted narration control.
Links: ![HuggingFace][link-huggingface] ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Website][link-website] ![Paper][link-paper] ![Demo][link-demo]
· · · · · · · · · · · · · ·
VoxFlash-TTS
VoxFlash-TTS
Description: VoxFlash-TTS is a zero-shot voice-cloning text-to-speech engine built around extreme latent compression. The VAE encodes 24 kHz waveforms into a 9 frames/s latent space — roughly 8× more compressed than EnCodec (75 fps) and 2.4× more than Stable Audio (21.5 fps). Generating 10 s of audio therefore requires the diffusion model to produce just 90 latent vectors rather than hundreds or thousands of tokens, with downstream quadratic savings in attention cost. A ConvNeXtV2-based phoneme encoder followed by a novel coarse-alignment algorithm (cheaper than cross-attention) maps text into the latent sequence; a modern diffusion head then iteratively refines speech latents that the lightweight VAE decoder renders back to waveforms. The architecture targets low-latency, low-resource deployment — consumer-grade GPUs and edge devices — with Chinese and English zero-shot cloning. The project card lists inference: false on HF (no hosted inference endpoint), but the project page at voxflash.github.io carries the abstract, demo examples, and ablations.
Release Date: May 22, 2026
| Feature | Value |
|---|---|
| Parameters | not stated (ConvNeXtV2 phoneme encoder + diffusion head + lightweight VAE decoder) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | Chinese, English |
| Streaming | ❌ |
| License | ![Apache 2.0][license-apache-2.0] |
| Audio Codec | VoxFlash VAE (9 Hz / 9 fps latent, 24 kHz input) |
| Compression Ratio | ~8× tighter than EnCodec (75 fps), ~2.4× tighter than Stable Audio (21.5 fps) |
| Phoneme Encoder | ConvNeXtV2 + coarse-alignment algorithm (no cross-attention) |
| Diffusion Head | modern multi-step iterative refinement |
| Decoder | lightweight VAE decoder |
| Sample Rate | 24,000 Hz |
| Inference | local CUDA ≥ 12.3.2; no HF hosted endpoint |
| Training Dataset | seed-tts-eval |
| Metrics | word_error_rate, speaker_similarity |
Features: The central technical move is compressing the audio latent space to 9 frames/s instead of the conventional 75 fps (EnCodec) or 21.5 fps (Stable Audio). This is not a quantization tweak — it is a temporal-decimation architectural choice that shrinks the sequence length the diffusion model has to traverse, and because attention cost scales quadratically with sequence length the end-to-end compute drops by orders of magnitude. Combined with a coarse-alignment phoneme-to-latent map that avoids cross-attention entirely (using a ConvNeXtV2 phoneme encoder instead), VoxFlash hits millisecond-level inference latency on consumer-grade and edge hardware for zero-shot Chinese + English cloning, where conventional latent-diffusion TTS systems are too slow for real-time edge deployment.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Website][link-website] ![Paper][link-paper]
· · · · · · · · · · · · · ·
Miso TTS
Miso TTS
Description: Miso TTS 8B is a text-to-speech model from Miso Labs built on the Sesame Conversational Speech Model (CSM) architecture. A large Llama-3.2-style backbone consumes text/audio-frame embeddings and predicts codebook 0 of the Mimi audio token stream, while a smaller 300M autoregressive audio decoder predicts codebooks 1–31 in codebook depth. The model is designed for high-quality conversational speech and voice continuation from a short prompt audio clip.
Release Date: May 21, 2026
| Feature | Value |
|---|---|
| Parameters | 8B (backbone llama-3.2-style) + 300M (audio decoder) = 8.3B |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | English |
| Streaming | ❌ |
| License | ![MIT][license-mit] |
| Architecture | Sesame-style CSM (two transformer stack: backbone + audio decoder) |
| Audio Tokenizer | Mimi (32 codebooks, vocab 2051, max seq 2048) |
| Library | pytorch |
Features: A two-transformer Sesame-style CSM (Llama 8B backbone consumes text + audio frames and produces backbone codebook-0 prediction; a 300M audio decoder autoregresses over codebook depth via Mimi's 32-codebook stack) — letting the larger backbone spend capacity on linguistic / speaker conditioning while a leaner decoder handles fine-grained codebook-by-codebook generation.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Website][link-website]
· · · · · · · · · · · · · ·
Raon-OpenTTS-1B
Raon-OpenTTS-1B
Description: Raon-OpenTTS is an open-data, open-weight zero-shot TTS system from KRAFTON that performs on par with state-of-the-art closed-data models. This is the 1B variant (1048M parameters). Both model weights and training data are public: Raon-OpenTTS-Core is 510.1K hours of English speech, quality-filtered from the 615K-hour public Raon-OpenTTS-Pool using combined DNSMOS, WER, and VAD rank-based filtering. It ranks 1st or 2nd in WER and SIM among recent zero-shot TTS models on Seed-TTS-Eval and CV3-Eval, and achieves the best average WER/SIM on Raon-OpenTTS-Eval across Clean, Noisy, Wild, and Expressive regimes. A smaller Raon-OpenTTS-0.3B variant is also available.
Release Date: May 21, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | English only (trained on 11 English speech datasets) |
| License | ![CC BY-NC 4.0][license-cc-by-nc-4.0] |
| Parameters | 1048M |
| Architecture | DiT (Diffusion Transformer) based on F5-TTS with flow matching; dim=1408, depth=28, heads=24 |
| Audio Output | 80-ch mel-spectrogram at 16 kHz, HiFi-GAN vocoder (LibriTTS) |
| Training Data | Raon-OpenTTS-Core (510.1K hours), 520K updates on 48× B200 |
Features: Demonstrates that fully open data + open weights can match proprietary SOTA: on Seed-TTS-Eval it reaches 1.78 WER / 0.749 SIM (vs Qwen3-TTS 1.46/0.715 at 1.7B), and best overall robustness (WER 2.81 / SIM 0.695) across four acoustic regimes on its own Raon-OpenTTS-Eval benchmark. The pipeline pairs large-scale rank-based data curation (DNSMOS + WER + VAD filtering of a 615K-hour pool) with an efficient F5-TTS-derived DiT.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![arXiv][link-arxiv] ![Dataset][link-dataset]
Additional Tools:
| Tool | Type | Link |
|---|---|---|
| ComfyUI-Raon-OpenTTS | ComfyUI node | ComfyUI-Raon-OpenTTS |
· · · · · · · · · · · · · ·
OronTTS
OronTTS
Description: OronTTS is a non-autoregressive text-to-speech model from btsee, an F5-TTS fork specialized for Mongolian (Khalkha Cyrillic) and Kazakh (Cyrillic). It uses Flow Matching + Diffusion Transformer + Vocos (dim 1024, depth 22, 16 heads, vocab 65, 24 kHz sample rate), trained on the btsee/mbspeech_mn corpus (3,846 Mongolian speech samples) and outputs zero-shot synthesis from a short reference audio + language tag.
Release Date: May 16, 2026
| Feature | Value |
|---|---|
| Parameters | (not stated) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | Mongolian (Khalkha Cyrillic), Kazakh (Cyrillic) |
| Streaming | ❌ |
| License | ![MIT][license-mit] |
| Architecture | F5-TTS (OT-CFM + DiT + Vocos) |
| Dim | 1024 |
| Depth | 22 |
| Heads | 16 |
| Vocab Size | 65 |
| Sample Rate | 24000 Hz |
| Mel Bins | 100 |
| Training Data | btsee/mbspeech_mn (3,846 Mongolian speech samples) |
Features: F5-TTS re-purposed for low-resource Cyrillic languages (Mongolian + Kazakh) — non-autoregressive flow-matching DiT over a tight 65-word vocab. Trained on a small (~3.8k sample) Mongolian corpus; the architecture is small enough that Khalkha Cyrillic and Kazakh Cyrillic share the same checkpoint via the lang tag at inference time.
Links: ![HuggingFace][link-huggingface]
· · · · · · · · · · · · · ·
Supertonic 3
Supertonic 3
Description: Supertonic 3 is the third-generation open-weight release from Supertone. It is a lightweight, on-device text-to-speech system that runs with ONNX Runtime entirely on the user's machine (no network, no API call) and ships as a Python SDK (pip install supertonic). Compared with the Supertonic 2 base (5 languages, 66 M params), v3 expands to 31 languages and adds expression tags (, , ``), more stable reading on long utterances, and higher speaker similarity across the core language set.
Release Date: May 6, 2026
| Feature | Value |
|---|---|
| Parameters | (not stated on card; Supertonic 2 baseline 66 M — likely similar or smaller weight class) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Emotion Control | ✅ |
| Languages | 31 (expanded from Supertonic 2's 5) |
| Streaming | ✅ |
| License | ![OpenRAIL-M][license-openrail-m] |
| On Device | yes (ONNX Runtime, no cloud call) |
| Expression Tags | yes (, , ``) |
Features: A more compact on-device multilingual TTS: ONNX-Runtime inference everywhere, 31 languages from a single small open-weight encoder, and discrete expression tags that the decoder interprets inline — without a separate speaker-emotion control path or a cloud-rendered audio round-trip.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Demo][link-demo] ![PyPI][link-pypi]
· · · · · · · · · · · · · ·
Scenema Audio
Scenema Audio
Description: Scenema Audio is a zero-shot expressive voice cloning and speech generation model from ScenemaAI. It is built on an audio diffusion transformer extracted from the audio branch of Lightricks' LTX 2.3 (a 22B audiovisual model) — keeping the in-the-wild acoustic quality the bigger model learned while specializing for speech output. Generation is prompt-driven: a tag carries a `voice` description, `gender`, optional `scene` (ambient audio around the voice), and `language`; an tag shifts emotional state mid-generation. Action tags cover rage, grief, joy, fear, exhaustion; voice prompt can describe timbre/pitch/breathiness/rasp/resonance plus character archetypes ("Tony Soprano having a breakdown"). Supports zero-shot voice cloning from 10-20 seconds of reference audio with some emotional variability, automatic long-form narration by splitting text and maintaining voice continuity, and 13 multilingual built-ins.
Release Date: April 26, 2026
| Feature | Value |
|---|---|
| Parameters | (audio diffusion transformer of LTX 2.3, weights ~9.8 GB bf16 / ~4.9 GB INT8 + ~6.7 GB pipeline) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Emotion Control | ✅ |
| Languages | 13 (en, de, fr, es, it, pt, ja, zh, ko, ru, ar, hi, sw) |
| Streaming | ❌ |
| License | ![Other][license-other] |
| Parent Model | Lightricks LTX-2.3 (audio branch) |
| Prompt Format | XML with tag for shifting emotion |
| Long Form Narration | yes (auto-splits text while preserving voice continuity) |
| Quantized | yes (INT8 weights at ~4.9 GB, identical quality) |
Features: A standalone audio diffusion transformer extracted from a much bigger multimodal source: the model inherits how people actually sound in real scenes (angry, laughing, whispering, crying, exhausted, terrified) and exposes that capacity through a + prompt interface — emotional state shifts within a single generation, instead of being a token-level or speaker-level conditioning problem.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Website][link-website]
· · · · · · · · · · · · · ·
Dramabox
Dramabox
Description: Dramabox is Resemble AI's expressive TTS, distributed under the LTX-2 Community License. It is an IC-LoRA fine-tune of the LTX-2.3 3.3B audio-only branch (Diffusion Transformer + flow matching), conditioned on Gemma 3 12B text embeddings. Generation is prompt-driven: speaker identity, emotion, delivery, laughs, sighs, breaths, pauses, and transitions are all expressed inside a natural-language description, with an optional 10-second voice reference that clones the target timbre.
Release Date: April 17, 2026
| Feature | Value |
|---|---|
| Parameters | 3.3B (LTX-2.3 audio backbone, IC-LoRA fine-tune) + 12B Gemma 3 text encoder (conditioning only) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Emotion Control | ✅ |
| Languages | English |
| Streaming | ❌ |
| License | ![Other][license-other] |
| Base Model | Lightricks/LTX-2.3 (audio branch) |
| Architecture | DiT + flow matching, IC-LoRA fine-tune, Gemma 3 12B text embeddings |
| Inference Time | ~2.5 s / generation (warm server) |
Features: IC-LoRA fine-tune of LTX-2.3's audio branch leaves the heavy text-understanding work to Gemma 3 12B and lets the DiT do the expressive rendering — so what's normally multimodal-stage orchestration collapses into a single prompt-driven TTS where speaker identity, emotion, and delivery are encoded in the prompt itself, and the timbre comes from a 10-second voice reference when present.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Demo][link-demo] ![Website][link-website]
· · · · · · · · · · · · · ·
Sarashina2.2-TTS
Sarashina2.2-TTS
Description: Sarashina2.2-TTS is a Japanese-centric text-to-speech system from SB Intuitions built on a large language model. It supports both Japanese and English, delivers strong pronunciation accuracy on Japanese text through large-scale end-to-end training, and reproduces a speaker's voice, speaking style, and acoustic characteristics from a short reference clip (zero-shot). Training data is sourced exclusively from legitimately acquired, properly licensed speech archives per the Sarashina Model NonCommercial License Agreement v2.0 (released April 24, 2026).
Release Date: April 16, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Emotion Control | ✅ |
| Languages | Japanese, English |
| Streaming | ❌ |
| License | ![Research Only][license-research-only] |
| Base Model | sbintuitions/sarashina2.2-0.5b-instruct-v0.1 |
| Cross Lingual | yes (Japanese ↔ English, code switching) |
Features: Japanese-optimized TTS fine-tuned on responsibly-licensed Japanese training corpora with explicit cross-lingual code-switching to English in a single utterance; reference audio carries speaking style and speaker identity together, so the same prompt yields narration, broadcast, conversation, or customer-service delivery without separate style conditioning.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Paper][link-paper]
· · · · · · · · · · · · · ·
LongCat-AudioDiT
LongCat-AudioDiT
Description: State-of-the-art diffusion-based TTS model operating directly in waveform latent space. Developed by Meituan's LongCat team, it requires only a Waveform VAE and Diffusion backbone, effectively mitigating compounding errors.
Release Date: March 30, 2026
| Feature | Value |
|---|---|
| Parameters | 1B / 3.5B |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ❌ |
| Emotion Control | ❌ |
| Languages | Chinese, English |
| Streaming | ❌ |
| Audio Output | 24000 Hz |
| License | ![MIT][license-mit] |
Features: Adaptive Projection Guidance (APG) replaces traditional classifier-free guidance for elevated generation quality. Outperforms Seed-TTS on zero-shot voice cloning benchmarks.
Links: ![GitHub][link-github] ![HuggingFace][link-huggingface] ![HuggingFace][link-huggingface]
· · · · · · · · · · · · · ·
SILMA TTS
SILMA TTS
Description: SILMA TTS v1 is a high-performance, 150M-parameter bilingual (Arabic/English) TTS model developed by SILMA AI. Built on the F5-TTS diffusion architecture, it was pretrained from scratch using tens of thousands of hours of high-quality public and proprietary data. It supports instant voice cloning with less than 8 seconds of reference audio (the reference transcript can also be left empty — it is transcribed on the fly), full support for Arabic Tashkeel (diacritics, auto-enriched via CATT when absent), NeMo-based text normalization, and an RTF around 0.12 on an RTX 4090. Released under a commercial-friendly license: code MIT, model weights Apache-2.0. The model is 100% compatible with F5-TTS v1.1.7 tooling for inference and fine-tuning.
Release Date: March 13, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Languages | 2 (Arabic MSA/Fusha + English) |
| License | ![Apache 2.0][license-apache-2.0] |
| Parameters | 150M |
| Architecture | F5-TTS Diffusion Transformer with flow matching (pretrained from scratch, F5-TTS v1.1.7-compatible) |
| Pronunciation | ✅ |
| Cost | RTF ≈ 0.12 (RTX 4090) |
Features: Brings native-level Arabic synthesis to a 150M footprint: one of the smallest open F5-TTS-family models pretrained from scratch rather than fine-tuned, with first-class Arabic handling (Tashkeel-aware pronunciation via CATT enrichment, NeMo text normalization) alongside English, plus instant zero-shot cloning under fully permissive licensing (Apache-2.0 weights / MIT code).
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Website][link-website]
· · · · · · · · · · · · · ·
Fish Audio S2 Pro
Fish Audio S2 Pro
Description: Fish Audio S2 Pro is a leading text-to-speech model with fine-grained inline control of prosody and emotion. It combines reinforcement learning alignment with a dual-autoregressive architecture for high-quality speech synthesis.
Release Date: March 10, 2026
| Feature | Value |
|---|---|
| Parameters | ~10 GB (BF16) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ✅ |
| Emotion Control | ✅ |
| Languages | 80+ (Tier 1: En, Zh, Jp) |
| Streaming | ✅ |
| License | ![Research Only][license-research-only] |
Links: ![GitHub][link-github] ![HuggingFace][link-huggingface]
· · · · · · · · · · · · · ·
LongCat-Next
LongCat-Next
Description: Native multimodal foundation model by Meituan LongCat Team processing text, vision, and audio under a single autoregressive objective. Industrial-strength model with strong speech synthesis and voice cloning.
Release Date: March 2026
| Feature | Value |
|---|---|
| Parameters | 3B (MoE A3B) |
| Voice Cloning | ✅ |
| Asr | ✅ |
| Pronunciation | ✅ |
| Emotion Control | ✅ |
| Languages | Chinese, English |
| Streaming | ✅ |
| Audio Output | 24 kHz |
| License | ![MIT][license-mit] |
Features: Discrete Native Autoregression Paradigm (DiNA) unifying modalities in shared discrete token space. Combines visual understanding, generation, and audio processing in single model.
Links: ![GitHub][link-github] ![HuggingFace][link-huggingface]
· · · · · · · · · · · · · ·
Voxtral-4B-TTS
Voxtral-4B-TTS
Description: Frontier, open-weights text-to-speech model developed by Mistral AI. Designed to be fast, instantly adaptable, and produces lifelike speech with natural prosody and emotional range.
Release Date: March 2026
| Feature | Value |
|---|---|
| Parameters | 4B |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ❌ |
| Emotion Control | ✅ |
| Languages | 9 (En, Fr, Es, De, It, Pt, Nl, Ar, Hi) |
| Streaming | ✅ |
| Audio Output | 24 kHz |
| License | ![CC BY-NC 4.0][license-cc-by-nc-4.0] |
Links: ![HuggingFace][link-huggingface] ![Demo][link-demo] ![Blog][link-blog]
· · · · · · · · · · · · · ·
Blue (Light Blue) TTS
Blue (Light Blue) TTS
Description: BlueTTS (project page: lightbluetts.com) is a multilingual text-to-speech library. Built around slim ONNX graphs that run on ONNX Runtime with first-class CPU support and optional accelerators — OpenVINO (Intel), CUDA ORT (NVIDIA), TensorRT, and ONNX Runtime stock CPU. Targets five languages — Hebrew, English, Spanish, Italian, German — including inline mixed-language with XML-style tags in the text prompt. Inference is deliverable as a PyPI package (blue-onnx), a Rust crate, or directly from the pinned ONNX graphs on the HF Hub; the v2 release ships a slimmed opset-17 ONNX bundle (notmax123/blue-onnx-v2) that's intended for both FP32 production and the experimental INT8 weight-only fallback.
Release Date: February 27, 2026
| Feature | Value |
|---|---|
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ✅ |
| Emotion Control | ❌ |
| Languages | Hebrew, English, Spanish, Italian, German |
| Streaming | ❌ |
| License | ![MIT][license-mit] |
| Runtime | ONNX Runtime (stock CPU; OpenVINO / CUDA / TensorRT optional) |
| Speed | "fastest open-source TTS" (per project description) |
| Graph Format | ONNX opset 17 (slim, full-precision; experimental weight-only INT8 fallback) |
| Distribution | PyPI + HuggingFace + Rust |
Features: A CPU-first multilingual TTS that ships both slimmed ONNX graphs and a Python package where the same code path runs on stock CPU ONNX Runtime by default — and optionally accelerates on OpenVINO / CUDA ORT / TensorRT — so deployment doesn't gate on GPU availability. Languages include Hebrew (with explicit G2P normalization) — a comparatively rare open-source TTS target — plus standard European languages, all from MIT-licensed weights distributed via both Hugging Face and PyPI.
Links: ![GitHub][link-github] ![HuggingFace][link-huggingface] ![PyPI][link-pypi] ![Website][link-website] ![Demo][link-demo]
· · · · · · · · · · · · · ·
KittenTTS
KittenTTS
Description: KittenTTS is an open-source realistic text-to-speech model designed for lightweight deployment. It is a state-of-the-art TTS model under 25MB with just 15 million parameters, running without GPU on any device.
Release Date: February 24, 2026 (v0.8.1)
| Feature | Value |
|---|---|
| Parameters | 15M-80M |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ❌ |
| Emotion Control | ✅ |
| Languages | English, Multiple |
| Streaming | ✅ |
| License | ![Apache 2.0][license-apache-2.0] |
Links: ![GitHub][link-github] ![HuggingFace][link-huggingface]
· · · · · · · · · · · · · ·
Ming-omni-tts
Ming-omni-tts
Description: Ming-omni-tts is a high-performance unified audio generation model in the Ming 2.0 series. It uses a custom 12.5 Hz continuous tokenizer and a Patch-by-Patch compression strategy that drives the LLM inference frame rate down to 3.1 Hz, enabling fine-grained control over speech rate, pitch, volume, emotion, and dialect (notably Cantonese at ~93 % accuracy). It supports 100+ premium built-in voices plus zero-shot voice design from natural-language prompts and is the first autoregressive model that jointly generates speech, ambient sound, and music in a single channel.
Release Date: February 11, 2026
| Feature | Value |
|---|---|
| Parameters | 16.8B (3B active, MoE; A3B) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Emotion Control | ✅ |
| Languages | Chinese, English, Cantonese |
| Streaming | ❌ |
| License | ![Apache 2.0][license-apache-2.0] |
Features: Patch-by-Patch compression drives the inference frame rate to 3.1 Hz, drastically cutting LLM-side latency for podcast-style audio while preserving naturalness. A custom 12.5 Hz continuous tokenizer plus a DiT head jointly produce speech, ambient sound, and music in a single output channel — an "in-the-scene" listening experience rather than TTS-on-top-of-a-track.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Website][link-website]
· · · · · · · · · · · · · ·
SoulX-Singer
SoulX-Singer
Description: SoulX-Singer is a high-fidelity, zero-shot singing voice synthesis model for generating realistic singing voices for unseen singers without fine-tuning.
Release Date: February 6, 2026
| Feature | Value |
|---|---|
| Parameters | - |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ✅ |
| Emotion Control | ✅ |
| Languages | Mandarin, English, Cantonese |
| Streaming | ✅ |
| License | ![Apache 2.0][license-apache-2.0] |
Links: ![GitHub][link-github] ![HuggingFace][link-huggingface] ![arXiv][link-arxiv]
· · · · · · · · · · · · · ·
SoproTTS
SoproTTS
Description: SoproTTS is a lightweight English text-to-speech model with zero-shot voice cloning. It uses dilated convolutions (WaveNet-style) and lightweight cross-attention layers instead of the common Transformer architecture.
Release Date: February 4, 2026 (v1.5)
| Feature | Value |
|---|---|
| Parameters | 135M |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ❌ |
| Emotion Control | ✅ |
| Languages | English |
| Streaming | ✅ |
| License | ![Apache 2.0][license-apache-2.0] |
| Rtf | 0.05 (CPU M3) |
| Training-Cost | ~$100 |
Links: ![GitHub][link-github] ![HuggingFace][link-huggingface]
· · · · · · · · · · · · · ·
Qwen3-TTS
Qwen3-TTS
Description: Qwen3-TTS is an open-source series of Text-to-Speech models developed by Alibaba Cloud. Supports stable, expressive, and streaming speech generation with free-form voice design.
Release Date: January 22, 2026
| Feature | Value |
|---|---|
| Parameters | 0.6B-1.7B |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ✅ |
| Emotion Control | ✅ |
| Languages | 10 (Chinese, English, Japanese, Korean, German, French, Russian, Portuguese, Spanish, Italian) |
| Streaming | ✅ |
| License | ![Apache 2.0][license-apache-2.0] |
Links: ![GitHub][link-github] ![HuggingFace][link-huggingface] ![arXiv][link-arxiv]
· · · · · · · · · · · · · ·
TADA
TADA
Description: TADA is a unified speech-language model from Hume AI built around a Text-Acoustic Dual-Alignment tokenizer: for every text/subword token there is exactly one corresponding speech vector, so the audio stream stays 1:1 aligned with text. As a TTS model, each autoregressive step covers one text token and dynamically determines the duration and prosody for that token, breaking the fixed-frames-per-second constraint that drives most modern TTS backbones. As a speech-language model, it generates a text token and the speech for the preceding token in the same dual step.
Release Date: January 12, 2026
| Feature | Value |
|---|---|
| Parameters | 1B (Llama 3.2 1B base) |
| Voice Cloning | ❌ |
| Asr | ❌ |
| Emotion Control | ✅ |
| Languages | English |
| Streaming | ❌ |
| License | ![Other][license-other] |
| Base Model | meta-llama/Llama-3.2-1B |
| Tokenization | 1:1 text–acoustic dual alignment (one speech vector per text token) |
| Dynamic Duration | yes (each autoregressive step covers one text token, duration is determined per-token) |
Features: A dual-alignment speech–text tokenizer that decouples autoregression from a fixed audio frame rate: each text token owns exactly one speech vector, and the model synthesizes the whole segment for that token in one step, regardless of how long the spoken form is — eliminating transcript hallucination and the latency overhead of constant-frame-rate codecs while staying as compact as Llama 3.2 1B.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Demo][link-demo] ![PyPI][link-pypi] ![Paper][link-paper] ![Blog][link-blog]
· · · · · · · · · · · · · ·
Irodori-TTS-500M-v2
Irodori-TTS-500M-v2
Description: Japanese Text-to-Speech model based on Rectified Flow Diffusion Transformer. Features emoji-based style and sound effect control by embedding emojis in input text for expressive speech generation.
Release Date: 2026
| Feature | Value |
|---|---|
| Parameters | 500M |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ❌ |
| Emotion Control | ✅ |
| Languages | Japanese |
| Streaming | ❌ |
| Audio Output | 48kHz waveform |
| License | ![MIT][license-mit] |
Features: Key Feature: Emoji annotation control - insert specific emojis into text to control speaking styles, emotions, and sound effects.
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github] ![Demo][link-demo]
· · · · · · · · · · · · · ·
KugelAudio
KugelAudio
Description: Open-source TTS for European languages with 7B parameters. Outperformed ElevenLabs in human preference testing.
Release Date: Early 2026
| Feature | Value |
|---|---|
| Parameters | 7B |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ✅ |
| Emotion Control | ✅ |
| Languages | 23 European languages |
| Streaming | ✅ |
| License | ![MIT][license-mit] |
Links: ![GitHub][link-github] ![HuggingFace][link-huggingface] ![Website][link-website]
· · · · · · · · · · · · · ·
LEMAS-TTS
LEMAS-TTS
Description: Part of the LEMAS (Large-scale Extensible Multilingual Audio Suite) project. Zero-shot multilingual TTS with 0.3B parameters supporting 10 languages with word-level precise editing capabilities.
Release Date: 2026
| Feature | Value |
|---|---|
| Parameters | 0.3B |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ✅ |
| Emotion Control | ✅ |
| Languages | 10 (zh/en/de/fr/es/pt/it/ru/id/vi) |
| Streaming | ❌ |
| License | ![Apache 2.0][license-apache-2.0] |
| Special-Feature | Word-level editing (LEMAS-Edit) |
Features: Built on 150,000+ hours of multilingual speech data with word-level timestamps. Includes LEMAS-Edit for precise word-level speech editing via masked token infilling.
Links: ![Website][link-website] ![HuggingFace][link-huggingface] ![HuggingFace][link-huggingface]
· · · · · · · · · · · · · ·
MioTTS-2.6B
MioTTS-2.6B
Description: Lightweight, high-speed LLM-based TTS model for English and Japanese with minimal resource usage.
Release Date: 2026
| Feature | Value |
|---|---|
| Parameters | 2.6B |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ❌ |
| Emotion Control | ❌ |
| Languages | English, Japanese |
| Streaming | ✅ |
| License | ![LFM][license-lfm] |
| Rtf | 0.135-0.145 |
Links: ![HuggingFace][link-huggingface] ![GitHub][link-github]
· · · · · · · · · · · · · ·
MOSS-TTS-Nano
MOSS-TTS-Nano
Description: Ultra-lightweight open-source multilingual speech generation model with only 0.1B parameters. Designed for realtime speech generation that runs directly on CPU without GPU.
Release Date: 2026
| Feature | Value |
|---|---|
| Parameters | 0.1B |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ❌ |
| Emotion Control | ❌ |
| Languages | 20 |
| Streaming | ✅ |
| Audio Output | 48 kHz Stereo |
| License | ![Apache 2.0][license-apache-2.0] |
Features: Pure autoregressive architecture with MOSS-Audio-Tokenizer-Nano. Compresses audio to 12.5 Hz token stream using RVQ with 16 codebooks. Runs on 4-core CPU.
Links: ![GitHub][link-github] ![HuggingFace][link-huggingface] ![Demo][link-demo]
· · · · · · · · · · · · · ·
NeuTTS
NeuTTS
Description: NeuTTS is a collection of open-source on-device TTS models with instant voice cloning. Built off LLM backbones with GGUF format quantizations for efficient on-device deployment.
Release Date: Early 2026
| Feature | Value |
|---|---|
| Parameters | 360M (Air), 120M (Nano) |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ❌ |
| Emotion Control | ❌ |
| Languages | English, Spanish, German, French |
| Streaming | ✅ |
| License | ![Apache 2.0][license-apache-2.0] |
| On-Device | yes (GGUF quantizations) |
Links: ![GitHub][link-github] ![HuggingFace][link-huggingface] ![HuggingFace][link-huggingface]
· · · · · · · · · · · · · ·
OmniVoice
OmniVoice
Description: Massive multilingual zero-shot TTS model scaling to 600+ languages. Uses diffusion language model-style discrete non-autoregressive architecture with single-stage text-to-acoustic mapping.
Release Date: 2026
| Feature | Value |
|---|---|
| Parameters | - |
| Voice Cloning | ✅ |
| Asr | ❌ |
| Pronunciation | ✅ |
| Emotion Control | ✅ |
| Languages | 600+ |
| Streaming | ❌ |
| License | ![Apache 2.0][license-apache-2.0] |
| Training-Data | 581k hours |
Features: Simplified single-stage architecture vs conventional two-stage pipelines. Full-codebook random masking strategy with LLM initialization for superior intelligibility. Noise-robust prompt processing.
Links: ![Website][link-website] ![HuggingFace][link-huggingface]
<p al