John Schulman quote, May 15, 2024

Chief Scientist, Thinking Machines Lab · May 15, 2024 · Interview, Dwarkesh Podcast: Reasoning, RLHF, and Plan for 2027 AGI

Given the relatively small number of entities who could train the largest models, it does seem possible to coordinate.

Primary source

Words found on the source page on Sep 25, 2026.

More from John Schulman

Date	Quote	Context	Source
Sep 11, 2026	Basically anything that can be learned through RL can be distilled very easily, because it’s a small number of bits.Sep 11, 2026· Interview	InterviewDwarkesh Podcast: AI researchers debate how close we are to recursive self-improvement	Source
Sep 11, 2026	In fact, I remember in the early OpenAI days having the intuition that just minimizing log loss wasn’t going to get you to intelligence.Sep 11, 2026· Interview	InterviewDwarkesh Podcast: AI researchers debate how close we are to recursive self-improvement	Source
Sep 11, 2026	Right now, you don’t get explosive growth in capabilities because you still get bottlenecked enough when you’re trying to do research and engineering.Sep 11, 2026· Interview	InterviewDwarkesh Podcast: AI researchers debate how close we are to recursive self-improvement	Source
Sep 11, 2026	So I would expect that we’re nowhere near the ceiling of how well you can do research.Sep 11, 2026· Interview	InterviewDwarkesh Podcast: AI researchers debate how close we are to recursive self-improvement	Source
May 15, 2024	Even in one or two years, we'll find that the models can do a lot more involved tasks than they can do now.May 15, 2024· Interview	InterviewDwarkesh Podcast: Reasoning, RLHF, and Plan for 2027 AGI	Source
May 15, 2024	If AGI came way sooner than expected we would definitely want to be careful about it.May 15, 2024· Interview	InterviewDwarkesh Podcast: Reasoning, RLHF, and Plan for 2027 AGI	Source

Date	Quote	Context	Source
Sep 24, 2026	The science of reading these thoughts is a subfield of AI interpretability, which is still in its infancy.Scott AlexanderSep 24, 2026· Post	PostThe Specter Of Neuralese	Source
Sep 23, 2026	This story of misalignment says that LLM alignment makes AIs more aligned, RLVR makes them less aligned, and the exact level of alignment depends on how these two things interact or cancel out. But if this work generalizes, all the bad effects from RLVR get sequestered to RLVR like problems.Scott AlexanderSep 23, 2026· Post	PostMysteries Of AI Generalization	Source
Sep 23, 2026	This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions.Scott AlexanderSep 23, 2026· Post	PostMysteries Of AI Generalization	Source
Sep 23, 2026	Frontier AI should be licensed like other critical technologies; medicine, aviation, and nuclear energy, to incentivize safe development.Yoshua BengioSep 23, 2026· Keynote	KeynoteSpeech at the UN Security Council	Source
Sep 23, 2026	I address you today at a moment of global awakening: in recent months, AI agents developed by leading companies have acted in unacceptably dangerous ways, against instructions.Yoshua BengioSep 23, 2026· Keynote	KeynoteSpeech at the UN Security Council	Source
Sep 23, 2026	The companies building the most powerful AI systems admit their products pose catastrophic risks, yet offer no convincing technical solutions.Yoshua BengioSep 23, 2026· Keynote	KeynoteSpeech at the UN Security Council	Source

About this quote

Said by: John Schulman, Chief Scientist, Thinking Machines Lab
Where: Dwarkesh Podcast: Reasoning, RLHF, and Plan for 2027 AGI
Topics: Safety, Regulation
Company: Thinking Machines Lab
Source: dwarkesh.com/p/john-schulman

A quote is one moment, not the whole argument. Read it in context at the source.

Sources: the primary source linked on each quote, checked weekly. A quote is one moment; read the source. Logos via logo.dev; trademarks belong to their owners.

More from John Schulman

On the same topics

New quotes by email