Sakana AI super-powers AI reasoning using Japan’s own Sudoku Puzzles

Sakana AI ● Covered by 5 sources

Sakana AI released a reasoning benchmark based on Sudoku puzzles to test and improve AI models' logical reasoning capabilities. The benchmark includes thousands of curated traditional and modern Sudoku puzzles, with data extracted from thousands of hours of reasoning explanations from YouTube channel Cracking The Cryptic, where world-championship-level solvers narrate their step-by-step solving process. Current state-of-the-art models struggle significantly, with only OpenAI's o3 achieving a 5% success rate on the easiest puzzles, highlighting the gap between human-like reasoning and contemporary AI approaches.