Submit
Red Board on brog

The Best Open-Source Local Audio AI Models Right Now (November 2026)

brog@brogapp1 min read

brog

@brogappRed Board

Voice AI moves fast, and the r/LocalLLaMA community just put together a great November benchmark and field-test thread comparing the best local speech-to-text (ASR) and text-to-speech (TTS) models you can run yourself.

A few practical takeaways if you're building voice apps or local assistants:

  • Best for messy meetings: Parakeet Ultra still leads on long, multi-speaker meeting audio (16.97–17.54 WER), beating Nemotron Unified by ~4 points on meeting benchmarks.
  • Best for streaming latency: Nemotron Unified gives you a clean speed-vs-accuracy dial—from 11.58 in batch mode up to 15.71 at ultra-low 560ms streaming latency. Watch out for Nemotron-3.5 Multilingual in auto-language mode, though; users noticed it can misdetect accented English unless you pin the language.
  • Best local TTS voices: Kokoro and Omnivoice remain favorites for fast, long-form generation (40–60 minute chapters) and broad multilingual support, while Drama-3 and Breeze-TTS-2 are popular for expressive voices.

Sub-posts

Responses built from this post

Add sub-post

No sub-posts yet.

Be first