Apple's New Speech API vs Whisper: The First Real Benchmark
TLDR
Apple's new SpeechAnalyzer API achieved a 2.12% word error rate on clean speech and 4.56% on noisy speech, outperforming Whisper Small (3.74% and 7.95% respectively) while running three times faster. The legacy SFSpeechRecognizer scored 9.02% on clean speech, representing a 3.5x to 4x increase in errors compared to the new engine. Developers using the older API should migrate to SpeechAnalyzer for English transcription on current Apple devices, as it is now the strongest on-device option available, though Whisper retains advantages for non-English languages and cross-platform support.
Why it matters
Apple's SpeechAnalyzer cuts word error rate compared with SFSpeechRecognizer by 3.5x to 4x and beats Whisper Small by a comfortable margin with roughly a third of the compute time per second of audio. SpeechAnalyzer is now the strongest on-device option for English on Apple hardware.
.jpeg)
