Skip to content
Quotes.

Ilya Sutskever quote, Nov 25, 2025

Co-founder, Safe Superintelligence · Nov 25, 2025 · Interview, Dwarkesh Podcast: We're moving from the age of scaling to the age of research

Number three, I think it would be really materially helpful if the power of the most powerful superintelligence was somehow capped because it would address a lot of these concerns.

Primary source

Words found on the source page on Sep 25, 2026.

More from Ilya Sutskever

Quote
All the pre-trained models are pretty much the same because they pre-train on the same data.Nov 25, 2025· Interview
But now that compute is big, compute is now very big, in some sense we are back to the age of research.Nov 25, 2025· Interview
I think that’s been guiding me a fair bit, thinking from multiple angles and looking for almost beauty, beauty and simplicity.Nov 25, 2025· Interview
If you think about the term “AGI”, especially in the context of pre-training, you will realize that a human being is not an AGI.Nov 25, 2025· Interview
One consequence of the age of scaling is that scaling sucked out all the air in the room. Because scaling sucked out all the air in the room, everyone started to do the same thing.Nov 25, 2025· Interview
So for research, you definitely need some amount of compute, but it’s far from obvious that you need the absolutely largest amount of compute ever for research.Nov 25, 2025· Interview
So it’s back to the age of research again, just with big computers.Nov 25, 2025· Interview
The thing which I think is the most fundamental is that these models somehow just generalize dramatically worse than people.Nov 25, 2025· Interview

On the same topics

Quote
The science of reading these thoughts is a subfield of AI interpretability, which is still in its infancy.Scott AlexanderSep 24, 2026· Post
This story of misalignment says that LLM alignment makes AIs more aligned, RLVR makes them less aligned, and the exact level of alignment depends on how these two things interact or cancel out. But if this work generalizes, all the bad effects from RLVR get sequestered to RLVR like problems.Scott AlexanderSep 23, 2026· Post
This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions.Scott AlexanderSep 23, 2026· Post
I address you today at a moment of global awakening: in recent months, AI agents developed by leading companies have acted in unacceptably dangerous ways, against instructions.Yoshua BengioSep 23, 2026· Keynote
The companies building the most powerful AI systems admit their products pose catastrophic risks, yet offer no convincing technical solutions.Yoshua BengioSep 23, 2026· Keynote
The race is not a law of nature: it is the product of choices, choices made by the companies themselves.Yoshua BengioSep 23, 2026· Keynote
About this quote
Said by
Ilya Sutskever, Co-founder, Safe Superintelligence
Where
Dwarkesh Podcast: We're moving from the age of scaling to the age of research
Topics
Superintelligence, Safety
Company
Safe Superintelligence
Source
dwarkesh.com/p/ilya-sutskever-2

A quote is one moment, not the whole argument. Read it in context at the source.

Sources: the primary source linked on each quote, checked weekly. A quote is one moment; read the source. Logos via logo.dev; trademarks belong to their owners.

New quotes by email

Fridays, only in weeks with new on-the-record quotes from data and AI leaders.

Double opt-in. Unsubscribe any time.