NVIDIA Releases NemotronLabs VoiceChat 11B: An Open Full-Duplex Speech-to-Speech Model with ~450 ms Turn-Taking and Live Tool Calling
MarkTechPost 2 months ago 32 ● 2 sources
NVIDIA released NemotronLabs VoiceChat 11B, an open end-to-end speech-to-speech model for real-time full-duplex conversation that replaces an ASR→LLM→TTS pipeline. It reports 448 ms smooth turn-taking latency on Full-Duplex-Bench 1.0. The model supports barge-in and live tool calling via a side-channel tool script output with operator-defined on-hold lines, but it is research-only and usable today only for teams with at least one 80 GB GPU.