Introducing HealthBench
OpenAI Blog
HealthBench is a new evaluation framework designed to test AI models in realistic healthcare scenarios using input from over 250 physicians. The benchmark was developed with contributions from 250 physicians to establish performance and safety standards. This creates a shared measurement system for assessing how well AI performs on actual health tasks rather than isolated tests.
Why it matters
HealthBench is a new evaluation benchmark for AI in healthcare which evaluates models in realistic scenarios. Built with input from 250+ physicians, it aims to provide a shared standard for model performance and safety in health.
