Import AI 448: AI R&D; Bytedance's CUDA-writing agent; on-device satellite AI

Import AI · 4 months ago

Researchers from GovAI and the University of Oxford proposed 14 metrics to measure AI R&D automation—the degree to which AI systems are building other AI systems—as a prerequisite for governing recursive self-improvement. The metrics include tracking AI performance on R&D tasks relative to humans, measuring oversight effectiveness, and monitoring compute distribution across AI development. These measurements would help companies, governments, and third parties understand and control the pace of AI progress before it becomes difficult to oversee.