OpenAI will sell you Astra, but not the system that scored 98.6% on ARC-AGI-3
The New Stack Matthew Burns ● Covered by 6 sources
OpenAI’s Astra scored very differently on ARC-AGI-3 depending on whether it was run through ARC Prize’s harness or OpenAI’s Provider Adapter. With the Provider Adapter, the unchanged GPT-6 Astra scored 98.6% and cost $17,332, versus 62.7% and $26,098 in ARC Prize’s standard harness. The result shifts attention from model selection to harness engineering because the surrounding software changes both score and cost.
Why it matters
Investor Matt Turck, whose fantastic podcast has hosted the people who built ARC-AGI, summed up Astra’s blockbuster benchmarks with three The post OpenAI will sell you Astra, but not the system that scored 98.6% on ARC-AGI-3 appeared first on The New Stack.
