Why Artificial Analysis uses Ai2's IFBench instruction-following eval

Allen Institute (AI2) · 2 months ago

Artificial Analysis adopted IFBench, an AI2-developed benchmark accepted to NeurIPS 2025, to measure how well language models follow complex natural-language instructions like specific word counts, sentence structures, and keyword placement simultaneously. IFBench scores cluster sharply by model family, with Grok 4.20 leading at 82.9%, followed by Google Gemini and OpenAI GPT models, while Claude models score substantially lower despite ranking higher on Artificial Analysis's broader Intelligence Index. The benchmark remains useful for comparing models because instruction-following capability develops independently from other heavily optimized areas like coding and tool use, preventing saturation unlike most evaluations that become obsolete within six months.