Zvi Mowshowitz quote, Sep 14, 2026

Writer, Don't Worry About the Vase · Sep 14, 2026 · Post, We Must Pace The Frontier

If you are relying on anything remotely like ‘automated alignment evals’ against potential superintelligences, I predict that you are rather cooked.

Primary source

Words found on the source page on Sep 25, 2026.

More from Zvi Mowshowitz

Date	Quote	Context	Source
Sep 14, 2026	If I was in charge of an alignment or interpretability team I would never run out of experiments to run and things to try, including having the time to properly talk to the models in the first place.Sep 14, 2026· Post	PostWe Must Pace The Frontier	Source
Sep 14, 2026	Over the summer there was a step change, as Mythos and Astra started kicking off the early stages of recursive self-improvement (RSI).Sep 14, 2026· Post	PostWe Must Pace The Frontier	Source
Sep 14, 2026	Remember that ‘they will probably say no’ is not a good argument for not trying, even if you are right that the odds are not so great.Sep 14, 2026· Post	PostWe Must Pace The Frontier	Source
Sep 14, 2026	Ultimately, global coordination is The Way. We can and should do things without it, to enable coordination, and to show good faith, and because as things are we would be better off acting unilaterally, including because our Chinese competition is fast following.Sep 14, 2026· Post	PostWe Must Pace The Frontier	Source

Date	Quote	Context	Source
Sep 24, 2026	The science of reading these thoughts is a subfield of AI interpretability, which is still in its infancy.Scott AlexanderSep 24, 2026· Post	PostThe Specter Of Neuralese	Source
Sep 23, 2026	This story of misalignment says that LLM alignment makes AIs more aligned, RLVR makes them less aligned, and the exact level of alignment depends on how these two things interact or cancel out. But if this work generalizes, all the bad effects from RLVR get sequestered to RLVR like problems.Scott AlexanderSep 23, 2026· Post	PostMysteries Of AI Generalization	Source
Sep 23, 2026	This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions.Scott AlexanderSep 23, 2026· Post	PostMysteries Of AI Generalization	Source
Sep 23, 2026	I address you today at a moment of global awakening: in recent months, AI agents developed by leading companies have acted in unacceptably dangerous ways, against instructions.Yoshua BengioSep 23, 2026· Keynote	KeynoteSpeech at the UN Security Council	Source
Sep 23, 2026	The companies building the most powerful AI systems admit their products pose catastrophic risks, yet offer no convincing technical solutions.Yoshua BengioSep 23, 2026· Keynote	KeynoteSpeech at the UN Security Council	Source
Sep 23, 2026	The race is not a law of nature: it is the product of choices, choices made by the companies themselves.Yoshua BengioSep 23, 2026· Keynote	KeynoteSpeech at the UN Security Council	Source

About this quote

Said by: Zvi Mowshowitz, Writer, Don't Worry About the Vase
Where: We Must Pace The Frontier
Topics: Safety, Superintelligence
Source: thezvi.substack.com/p/we-must-pace-the-frontier

A quote is one moment, not the whole argument. Read it in context at the source.

Sources: the primary source linked on each quote, checked weekly. A quote is one moment; read the source. Logos via logo.dev; trademarks belong to their owners.

More from Zvi Mowshowitz

On the same topics

New quotes by email