Import AI 448: AI R&D; Bytedance's CUDA-writing agent; on-device satellite AI
Import AI Jack Clark
Researchers from GovAI and the University of Oxford proposed 14 metrics to measure AI R&D automation—the degree to which AI systems are building other AI systems—as a prerequisite for governing recursive self-improvement. The metrics include tracking AI performance on R&D tasks relative to humans, measuring oversight effectiveness, and monitoring compute distribution across AI development. These measurements would help companies, governments, and third parties understand and control the pace of AI progress before it becomes difficult to oversee.
Why it matters
If Ukraine is the first major drone war, when will there be the first major AI war?
Related stories
Inside the Race to Make AI Build Itself
CSET Georgetown · 1 month ago ·
28
Import AI 467: Self-sustaining AI viruses; pacing AI progress; confusion about AI and creativity
Import AI · 1 month ago ·
19
Import AI 463: Self-improving robots; a 10k Chinese GPU cluster; and an elegiac essay for the human era
Import AI · 2 months ago ·
49