But however uncertain and unlikely these risks are, if they did manifest themselves, the consequences would be incredibly serious.
Words found on the source page on Nov 6, 2026.
More from Rishi Sunak
TalkPrime Minister's speech on AIOct 26, 2023
And in a million different ways, across every aspect of our lives, AI can be that answer.TalkPrime Minister's speech on AIOct 26, 2023
And in any case, how can we write laws that make sense for something we don’t yet fully understand?TalkPrime Minister's speech on AIOct 26, 2023
Now, I want to be completely clear: This is not a risk that people need to be losing sleep over right now.TalkPrime Minister's speech on AIOct 26, 2023
Now, I’m unashamedly optimistic about the power of technology to make life better for everyone.TalkPrime Minister's speech on AIOct 26, 2023
Right now, we don’t have a shared understanding of the risks that we face.TalkPrime Minister's speech on AIOct 26, 2023
So, we should not rely on them marking their own homework, as many of those working on this would agree. Not least because only governments can properly assess the risks to national security. And only nation states have the power and legitimacy to keep their people safe.
On the same topics
BlogThe Specter Of NeuraleseSep 24, 2026
The science of reading these thoughts is a subfield of AI interpretability, which is still in its infancy.BlogMysteries Of AI GeneralizationSep 23, 2026
This story of misalignment says that LLM alignment makes AIs more aligned, RLVR makes them less aligned, and the exact level of alignment depends on how these two things interact or cancel out. But if this work generalizes, all the bad effects from RLVR get sequestered to RLVR like problems.BlogMysteries Of AI GeneralizationSep 23, 2026
This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions.TalkSpeech at the UN Security CouncilSep 23, 2026
I address you today at a moment of global awakening: in recent months, AI agents developed by leading companies have acted in unacceptably dangerous ways, against instructions.TalkSpeech at the UN Security CouncilSep 23, 2026
The companies building the most powerful AI systems admit their products pose catastrophic risks, yet offer no convincing technical solutions.TalkSpeech at the UN Security CouncilSep 23, 2026
The race is not a law of nature: it is the product of choices, choices made by the companies themselves.
About this quote
Quotesby Glyph