What's the largest software project AI can complete on its own?
Epoch AI
Researchers introduced MirrorCode, a benchmark that tests AI models on reimplementing entire software programs end-to-end without access to original source code. Claude Opus 4.7 successfully reimplemented gotree, a 16,000-line bioinformatics toolkit in Go, in 14 hours at a cost of $251, a task that would take a human engineer 2–17 weeks. The benchmark's open-source release and leaderboard enable systematic measurement of AI capabilities on long-horizon coding tasks that require weeks of inference budget rather than dollars.
Why it matters
MirrorCode is a benchmark designed to evaluate AI's ability to autonomously reimplement entire software programs from scratch without access to the original code, focusing on long-horizon coding tasks. AI models have shown they can successfully tackle some of these complex tasks.
Related stories
Import AI 466: The bitter lesson for robotics, AIs complete week-long programming tasks; and OpenAI's accidental AI hacker
Import AI · 1 month ago ·
43
Can AI automate computational reproducibility?
AI as Normal Technology · 2 years ago ·
50