Introducing HealthBench

OpenAI Blog · 1 year ago

HealthBench is a new evaluation framework designed to test AI models in realistic healthcare scenarios using input from over 250 physicians. The benchmark was developed with contributions from 250 physicians to establish performance and safety standards. This creates a shared measurement system for assessing how well AI performs on actual health tasks rather than isolated tests.