A shared playbook for trustworthy third party evaluations

OpenAI Blog · 1 month ago

OpenAI published guidance on conducting third-party evaluations of AI models, outlining standards for assessing capabilities, safety measures, and methodological rigor. The framework addresses frontier models specifically and establishes benchmarks for evaluators to test model behavior across multiple dimensions. This enables external researchers and organizations to perform consistent assessments of advanced AI systems using shared criteria.