AI and compute

OpenAI Blog · 8 years ago

Compute used in the largest AI training runs has doubled every 3.4 months since 2012, roughly 7 times faster than Moore's Law's historical 2-year doubling cycle. The total increase over this period exceeds 300,000x, compared to a 7x increase if Moore's Law had applied. This acceleration suggests preparation is needed for AI systems substantially more capable than those available today.