Cambridge Researchers Warn Automated AI R&D Could Trigger a Rapid Intelligence Explosion

Cambridge researchers warn that automating AI research and development could compress years of progress into months, risking loss of control over superhuman systems as AI already writes most code at the companies building it.

• A Cambridge Programme on AI Science & Policy paper warns that automating AI R&D could trigger an intelligence explosion that compresses years of progress into months or less.
• The paper says AI systems now write most code inside the companies developing them and could automate most AI R&D within a few years, possibly all of it.
• The authors urge policymakers to gain visibility into AI R&D automation and develop constraints, warning rapid capability growth could cause loss of control over superhuman AI and erode institutional checks on power.