Apple's New Speech API vs Whisper: The First Real Benchmark

TLDR · 2 days ago

Apple's new SpeechAnalyzer API achieved a 2.12% word error rate on clean speech and 4.56% on noisy speech, outperforming Whisper Small (3.74% and 7.95% respectively) while running three times faster. The legacy SFSpeechRecognizer scored 9.02% on clean speech, representing a 3.5x to 4x increase in errors compared to the new engine. Developers using the older API should migrate to SpeechAnalyzer for English transcription on current Apple devices, as it is now the strongest on-device option available, though Whisper retains advantages for non-English languages and cross-platform support.