David Shapiro’s Substack
David Shapiro
"Straight lines on a logarithmic scale"―All evidence points to an intelligence explosion
0:00
-24:36

"Straight lines on a logarithmic scale"―All evidence points to an intelligence explosion

AI is proceeding exponentially, the data is clear. However, other constraints and bottlenecks will limit its rate of deployment and impact to science and economics.

Sources:

My Stuff:

🚀 Intelligence Explosion on the Horizon

Sam Altman recently published a blog post discussing the potential for an intelligence explosion. He predicts AI will become personal assistants, enable personalized education, and change jobs more slowly than some expect. Altman claims unprecedented prosperity and superintelligence could arrive in as few as 1000 days. However, his post contains mostly vague promises with few concrete claims.

📊 AI Progress Data from Epoch AI

New research from Epoch AI provides compelling data on AI progress. Training compute for AI models is doubling every 6 months. Training costs for frontier models double every 9 months. Language model capabilities are scaling faster than vision models. The amount of training data used is doubling every 8 months. Training time is increasing by 20% annually. Power requirements for AI training are doubling yearly. This data shows no signs of diminishing returns in AI capabilities.

🧠 Intelligence vs Other Constraints

While intelligence is a significant constraint in many domains, it is not always the primary limiting factor. Large scientific projects like the Large Hadron Collider and James Webb Space Telescope face constraints of money, time, energy, and materials more than intelligence. Even with superintelligent AI, many industries will still face physical and logistical constraints. Matter, energy, time, space, and entropy remain fundamental limitations on progress.

🤖 The Path to Superintelligence

Achieving superintelligence faces constraints of data, energy, and compute. Companies are working to address these limitations through nuclear power, fusion research, and massive data centers. However, expanding human knowledge often requires slow, expensive experiments that AI cannot circumvent. Within existing knowledge, AI can drive rapid progress in product development and applied research.

💼 Jobs and Automation

As AI and robotics advance, an "automation cliff" may occur where demand for human labor increases until suddenly dropping to zero for certain jobs. This transition will likely happen gradually across different industries. While some argue automation creates more jobs than it destroys, the long-term impact remains uncertain. Careful monitoring of employment data will be crucial as AI capabilities expand.

When the data is this consistent, I tend to pay attention.
Data input is going up 3x every year
Power requirements are more than doubling every year
Costs are more than doubling every year
Moore’s Law (and Ray Kurzweil) have proven to be durable and accurate.

Discussion about this podcast

David Shapiro’s Substack
David Shapiro
Navigating the Fourth Industrial Revolution!