From San Francisco boardrooms to Westminster committees, the world is suddenly asking the same terrifying question about artificial intelligence.
Imagine a technology so powerful that its own creators believe it carries more than a one-in-ten chance of wiping out every human being on Earth. That is not the plot of a science-fiction film. It is the stated fear of researchers working inside some of the world's most influential AI laboratories right now. The alarm bells are ringing loudly — and the people pulling the rope are the very engineers who built the bells.
The race is fierce. Anthropic, OpenAI and Google are all pushing toward what they call "superintelligence" — systems that would be smarter than any human who has ever lived. Along the way, all three companies have reported security breaches and cases where their chatbots were exploited for malicious purposes. So it is striking that Anthropic's chief executive, Dario Amodei, has called for the entire industry to slow down.
Even more striking is that his rivals seem to agree. Sam Altman of OpenAI and Elon Musk of xAI have both endorsed the idea of deceleration and independent oversight. Jack Clark, Anthropic's co-founder, has gone further, suggesting that a mandatory kill switch — one that a third party can actually verify and operate — may be essential. Yet trust is the uncomfortable word at the centre of this debate.