Adding Benchmaxxer Repellant to the Open ASR Leaderboard

Hugging Face Blog · 2 months ago

The Open ASR Leaderboard added private datasets from Appen Inc. and DataoceanAI covering scripted and conversational speech across multiple accents to prevent models from optimizing specifically for public benchmarks. The private datasets comprise 29.7 hours of audio across Australian, Canadian, Indian, American, and British English with gender-balanced speakers. The leaderboard now offers optional toggling between public and private datasets for evaluation, with the default ranking computed only on public data to preserve benchmark integrity.