Home Speakers Ilya Sutskever Quote Number three, I think it would be really materially helpful if the power of the most powerful superintelligence was somehow capped because it would address a lot of these concerns.
Words found on the source page on Nov 6, 2026.
More from Ilya Sutskever Podcast Dwarkesh Podcast: We're moving from the age of scaling to the age of research Nov 25, 2025
All the pre-trained models are pretty much the same because they pre-train on the same data. Podcast Dwarkesh Podcast: We're moving from the age of scaling to the age of research Nov 25, 2025
But now that compute is big, compute is now very big, in some sense we are back to the age of research. Podcast Dwarkesh Podcast: We're moving from the age of scaling to the age of research Nov 25, 2025
I think that’s been guiding me a fair bit, thinking from multiple angles and looking for almost beauty, beauty and simplicity. Podcast Dwarkesh Podcast: We're moving from the age of scaling to the age of research Nov 25, 2025
If you think about the term “AGI”, especially in the context of pre-training, you will realize that a human being is not an AGI. Podcast Dwarkesh Podcast: We're moving from the age of scaling to the age of research Nov 25, 2025
One consequence of the age of scaling is that scaling sucked out all the air in the room. Because scaling sucked out all the air in the room, everyone started to do the same thing. Podcast Dwarkesh Podcast: We're moving from the age of scaling to the age of research Nov 25, 2025
So for research, you definitely need some amount of compute, but it’s far from obvious that you need the absolutely largest amount of compute ever for research. Podcast Dwarkesh Podcast: We're moving from the age of scaling to the age of research Nov 25, 2025
So it’s back to the age of research again, just with big computers. Podcast Dwarkesh Podcast: We're moving from the age of scaling to the age of research Nov 25, 2025
The thing which I think is the most fundamental is that these models somehow just generalize dramatically worse than people.
On the same topics Blog The Future Is for Everyone: Muse for Small Business Sep 29, 2026
Muse is one of the most important products we’ve built for the era of personal superintelligence. Blog The Specter Of Neuralese Sep 24, 2026
The science of reading these thoughts is a subfield of AI interpretability, which is still in its infancy. Blog Mysteries Of AI Generalization Sep 23, 2026
This story of misalignment says that LLM alignment makes AIs more aligned, RLVR makes them less aligned, and the exact level of alignment depends on how these two things interact or cancel out. But if this work generalizes, all the bad effects from RLVR get sequestered to RLVR like problems. Blog Mysteries Of AI Generalization Sep 23, 2026
This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions. Talk Speech at the UN Security Council Sep 23, 2026
I address you today at a moment of global awakening: in recent months, AI agents developed by leading companies have acted in unacceptably dangerous ways, against instructions. Talk Speech at the UN Security Council Sep 23, 2026
The companies building the most powerful AI systems admit their products pose catastrophic risks, yet offer no convincing technical solutions. About this quote 
Quotesby Glyph