Measuring progress toward AGI: A cognitive framework
Google DeepMind
Google DeepMind released a cognitive framework for measuring progress toward artificial general intelligence, drawing on psychology and neuroscience research to identify 10 key cognitive abilities including perception, reasoning, memory, and social cognition. The company is launching a Kaggle hackathon with $200,000 in prize money running from March 17 through April 16 to build evaluations for five abilities where measurement gaps are largest: learning, metacognition, attention, executive functions, and social cognition. The framework will allow researchers to benchmark AI system performance against human baselines across cognitive tasks to track incremental progress toward AGI.
Why it matters
We’re introducing a framework to measure progress toward AGI, and launching a Kaggle hackathon to build the relevant evaluations.
