Skip to content
Quotes.

John Schulman quote, May 15, 2024

Chief Scientist, Thinking Machines Lab · May 15, 2024 · Interview, Dwarkesh Podcast: Reasoning, RLHF, and Plan for 2027 AGI

If AGI came way sooner than expected we would definitely want to be careful about it.

Primary source

Words found on the source page on Sep 25, 2026.

More from John Schulman

Quote
Basically anything that can be learned through RL can be distilled very easily, because it’s a small number of bits.Sep 11, 2026· Interview
In fact, I remember in the early OpenAI days having the intuition that just minimizing log loss wasn’t going to get you to intelligence.Sep 11, 2026· Interview
Right now, you don’t get explosive growth in capabilities because you still get bottlenecked enough when you’re trying to do research and engineering.Sep 11, 2026· Interview
So I would expect that we’re nowhere near the ceiling of how well you can do research.Sep 11, 2026· Interview
Even in one or two years, we'll find that the models can do a lot more involved tasks than they can do now.May 15, 2024· Interview
Given the relatively small number of entities who could train the largest models, it does seem possible to coordinate.May 15, 2024· Interview

On the same topics

Quote
The science of reading these thoughts is a subfield of AI interpretability, which is still in its infancy.Scott AlexanderSep 24, 2026· Post
This story of misalignment says that LLM alignment makes AIs more aligned, RLVR makes them less aligned, and the exact level of alignment depends on how these two things interact or cancel out. But if this work generalizes, all the bad effects from RLVR get sequestered to RLVR like problems.Scott AlexanderSep 23, 2026· Post
This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions.Scott AlexanderSep 23, 2026· Post
I address you today at a moment of global awakening: in recent months, AI agents developed by leading companies have acted in unacceptably dangerous ways, against instructions.Yoshua BengioSep 23, 2026· Keynote
The companies building the most powerful AI systems admit their products pose catastrophic risks, yet offer no convincing technical solutions.Yoshua BengioSep 23, 2026· Keynote
The race is not a law of nature: it is the product of choices, choices made by the companies themselves.Yoshua BengioSep 23, 2026· Keynote
About this quote
Said by
John Schulman, Chief Scientist, Thinking Machines Lab
Where
Dwarkesh Podcast: Reasoning, RLHF, and Plan for 2027 AGI
Topics
AGI, Safety
Company
Thinking Machines Lab
Source
dwarkesh.com/p/john-schulman

A quote is one moment, not the whole argument. Read it in context at the source.

Sources: the primary source linked on each quote, checked weekly. A quote is one moment; read the source. Logos via logo.dev; trademarks belong to their owners.

New quotes by email

Fridays, only in weeks with new on-the-record quotes from data and AI leaders.

Double opt-in. Unsubscribe any time.