On a grey morning in Ayrshire, Scotland, one of the world's most powerful industries was summoned — not by a government or a regulator, but by a king. King Charles III convened a closed summit at Dumfries House, bringing together executives from Nvidia, OpenAI and Anthropic alongside the UK's AI Minister, Kanishka Narayan, and an adviser to the Pope. The guest list alone signalled something unusual: this was not a product launch or an investor call. It was, in effect, a moral reckoning.

The King did not hold back. He told the assembled executives that those who had built these systems were themselves warning that AI risks developing "darker capacities — perhaps even to take life." He argued that there was a growing urgency to confront what he called the "existential dangers" of such technologies falling into the wrong hands and being used in "potentially catastrophic ways." His charge to the room was direct: the task before them was not merely to advance technology, but to ensure it remained in the service of humanity, community and the natural world.

The industry's own voices were divided on how quickly that service could be guaranteed. Jensen Huang, chief executive of Nvidia — currently the world's most valuable company, with a market capitalisation of approximately $5.15 trillion — argued that safety was "paramount" and that products not yet safe enough should simply not be released. He also championed open AI models as a way to prevent poorer nations and smaller institutions from being left behind.

Sir Demis Hassabis of Google DeepMind, by contrast, urged caution about the pace of development, warning that artificial general intelligence may be arriving faster than society's ability to absorb it. The summit's stated goal was to explore whether a shared set of guiding principles could be agreed upon across borders and organisations.