Introducing Real World VoiceEQ: Measuring the human quality of voice AI

Hugging Face Blog · 1 day ago

Hume AI released Real World VoiceEQ, a benchmark that evaluates voice AI systems on human-quality interactions beyond traditional metrics like word error rates and latency. The benchmark drew from over 1 million human ratings across 40+ voice models and 60+ metrics spanning speech recognition, synthesis, and understanding tasks. The findings show no single voice model excels across all capabilities, and current systems struggle to interpret emotional cues and acoustic information that humans naturally recognize in conversation.