Nadella Says Advanced AI Needs an Emergency Brake Humans Control
Summary
Microsoft CEO Satya Nadella says advanced AI systems need containment, independent controls and an emergency brake that lets authorized people pause or shut a model mid-task. Writing on X, Nadella says frontier models should be treated like insider risks. President Donald Trump opposes slowing US AI development and launched an AI Force led by Jay Clayton.
Key Points
- An Anthropic alignment lead says there is a greater than 10 percent chance AI could "kill all humans" within a decade.
- An AI researcher who quit Anthropic last month accuses the company of "gambling with our lives."
- Nadella writes the most trustworthy superintelligence system enables us "to trust the model the least."