Jensen Huang, CEO of Nvidia, the world’s most valuable technology company, revealed that King Charles III personally handed him a letter containing a speech warning about the risks of artificial intelligence (AI). Huang shared this during the ceremony at St James’s Palace, where he was honoured with the 2025 Queen Elizabeth Prize for Engineering alongside six other pioneers in AI. The letter was a copy of the King’s 2023 address at the inaugural AI Safety Summit held at Bletchley Park. In that speech, the monarch highlighted the urgent need to confront AI’s risks with “a sense of urgency, unity and collective strength,” underscoring his deep concern for AI safety.
King Charles III described the rapid development of advanced AI as no less significant than historical scientific milestones such as the discovery of electricity and the splitting of the atom. He emphasised the transformative potential of AI to revolutionise sectors across the UK and beyond, including healthcare and green energy. However, the King also issued a stern reminder that AI technology could be wielded for both benevolent and malevolent purposes, thus necessitating robust efforts to advance AI safety measures.
This address is part of a broader context in the UK where governmental and industry leaders have been vocal about AI’s double-edged nature. Prime Minister Rishi Sunak, speaking at the same 2023 AI Safety Summit, acknowledged AI’s transformative promise while also recognising the fears and novel dangers it poses. To address these concerns, Sunak announced the creation of the world’s first AI Safety Institute, dedicated to assessing and promoting the safe development of AI technologies. His government’s proactive stance aligns with the King’s call for collective responsibility in managing AI’s impact on society.
The 2025 Queen Elizabeth Prize for Engineering ceremony also celebrated the groundbreaking contributions of seven engineers, including Huang and noted researchers such as Yoshua Bengio, Geoffrey Hinton, and Yann LeCun. Their work in modern machine learning—the backbone of current AI advancements—has driven progress across algorithms, hardware, and data quality, enabling innovations that significantly influence daily life and industry. The laureates’ achievements underscore the profound technological leap AI represents, a leap that has some experts describing it as one of the greatest technological advancements in human history.
However, the discourse on AI is not without its complexities. Some prominent figures, including former US President Donald Trump, have urged rapid development and deployment of AI technologies, advocating for speed over caution. This contrasts with the cautionary tones echoed by many in the scientific community and echoed in King Charles's warnings. The AI Safety Summit itself was renamed the AI Action Summit earlier in 2023, signalling a shift towards balancing progress with safety concerns.
In this evolving conversation, King Charles III’s direct engagement—personally presenting his cautionary speech to Nvidia’s CEO—adds significant weight to the call for responsible AI stewardship. His framing of AI development as a momentous challenge comparable to the discovery of electricity highlights both the transformative possibilities and the attendant risks. As governments, industry leaders, and innovators navigate this terrain, the imperative articulated by the British monarchy emphasizes collaborative vigilance to ensure AI benefits society without compromising safety.
📌 Reference Map:
- [1] (BBC) - Paragraph 1, Paragraph 2, Paragraph 6
- [2] (Evening Standard) - Paragraph 2
- [3] (Queen Elizabeth Prize official) - Paragraph 4, Paragraph 5
- [4] (UK Government) - Paragraph 3
- [5] (Engineering Council) - Paragraph 4
- [6] (UK Government) - Paragraph 3
- [7] (BBC) - Paragraph 2
Source: Noah Wire Services