We must agree collectively that no one, no company and no country, should develop an AI system that could cause large-scale harm.
Words found on the source page on Nov 6, 2026.
More from Yoshua Bengio
TalkSpeech at the UN Security CouncilSep 23, 2026
Frontier AI should be licensed like other critical technologies; medicine, aviation, and nuclear energy, to incentivize safe development.TalkSpeech at the UN Security CouncilSep 23, 2026
I address you today at a moment of global awakening: in recent months, AI agents developed by leading companies have acted in unacceptably dangerous ways, against instructions.TalkSpeech at the UN Security CouncilSep 23, 2026
The companies building the most powerful AI systems admit their products pose catastrophic risks, yet offer no convincing technical solutions.TalkSpeech at the UN Security CouncilSep 23, 2026
The race is not a law of nature: it is the product of choices, choices made by the companies themselves.BlogWhy are AI agents lying, cheating and coordinating?Sep 11, 2026
Bottom line: these hypotheses suggest that as AI capabilities keep growing, this kind of behavior could keep growing in severity too, unless we revisit the principles by which the most advanced models are trained.BlogWhy are AI agents lying, cheating and coordinating?Sep 11, 2026
This outcome is not inevitable, and it can be corrected with effective governance and a different training framework for AI.BlogIntroducing LawZeroJun 3, 2025
I am launching a new non-profit AI safety research organization called LawZero, to prioritize safety over commercial imperatives.BlogIntroducing LawZeroJun 3, 2025
These and other results point to an implicit drive for self-preservation.BlogIntroducing LawZeroJun 3, 2025
This is what the current trajectory of AI development feels like: a thrilling yet deeply uncertain ascent into uncharted territory, where the risk of losing control is all too real, but competition between companies and countries incentivizes them to accelerate without sufficient caution.
On the same topics
BlogThe Specter Of NeuraleseSep 24, 2026
The science of reading these thoughts is a subfield of AI interpretability, which is still in its infancy.BlogMysteries Of AI GeneralizationSep 23, 2026
This story of misalignment says that LLM alignment makes AIs more aligned, RLVR makes them less aligned, and the exact level of alignment depends on how these two things interact or cancel out. But if this work generalizes, all the bad effects from RLVR get sequestered to RLVR like problems.BlogMysteries Of AI GeneralizationSep 23, 2026
This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions.BlogBanning self-recursive improvement in AI models?Sep 22, 2026
Even if you believe in a deal with China, and I do not, we (and others) now know competitors can catch up more quickly than we had thought, at least if they think they have a chance of winning.BlogBanning self-recursive improvement in AI models?Sep 22, 2026
If the top U.S. labs have to give up on what is supposed to be really important, they will look very “catchable.” The policy creates a big incentive for some other parts of the world to invest a lot more in compute.PressLaunch of the roadmap of the Coalition for Children's Rights and Protection in the Age of AISep 22, 2026
AI must not be placed in the hands of children without first being tested, evaluated, and therefore authorized.
About this quote
Quotesby Glyph