We will probably need to slow down during the intelligence explosion, so we need to establish the mechanism to do so as soon as possible.
Unverified
Words found on the source page on Nov 20, 2026.
More from Daniel Kokotajlo
BlogPacing AI via Compute ReallocationNov 18, 2026
Combination with safety and security requirements We don’t currently have a science of AI risk sufficient to make conditional triggers that will be robust in the future, so we think an unconditional implementation of this proposal is needed as a stopgap.UnverifiedBlogPacing AI via Compute ReallocationNov 18, 2026
This assumes compute growth is constant; if compute growth slows in the future (as is likely , absent large AI-driven speedups), then takeoff could also be slower.UnverifiedBlogQ3.5 Timelines Update: Looks Like the Intelligence Explosion Will Happen in 2027 After AllNov 10, 2026
Also, it assumes that (uplift-1) will be exponential in ECI, while I expect it to be superexponential (based on how coding uplift evolves in the AI Futures Model, and the fact that I think there is such huge variation in the human range in value of research taste labor (meaning that as more of the gains come from taste, uplift will increase faster)).UnverifiedBlogVerified Compute Allocation Disclosures as a Foundational Governance ToolNov 10, 2026
I think verifying compute allocations could be extremely valuable, but I’ve been blocked on clear ways to demarcate compute use as “for safety/capabilities R&D/external customers/internal agents/experiments” outside of company judgement.UnverifiedBlogSenate Testimony Sept 2026Oct 2, 2026
They’ll be reliant on AI-generated explanations to understand what’s happening, and everything will be happening faster and faster.UnverifiedPodcastDwarkesh Podcast: AI 2027 with Scott Alexander and Daniel KokotajloApr 3, 2025
But I think that I’ve now become somewhat disillusioned and think that even if we do have a three-month lead, a six-month lead, between the leading US project and any serious competitor, it’s not at all foregone conclusion that they will burn that lead for good purposes, either for safety or for constitutional power stuff.PodcastDwarkesh Podcast: AI 2027 with Scott Alexander and Daniel KokotajloApr 3, 2025
I feel like we can’t just unilaterally slow down and have China go take the lead.PodcastDwarkesh Podcast: AI 2027 with Scott Alexander and Daniel KokotajloApr 3, 2025
So the crucial turning point is mid-2027, when they’ve basically fully automated the AI R&D process and they’ve got this corporation within a corporation, the army of geniuses that are autonomously doing all this research and they’re continually being trained to improve their skills, blah, blah, blah.EssayAI 2027 (with Scott Alexander, Thomas Larsen, Eli Lifland, Romeo Dean)Apr 3, 2025
Trying to predict how superhuman AI in 2027 would go is like trying to predict how World War 3 in 2027 would go, except that it’s an even larger departure from past case studies.EssayAI 2027 (with Scott Alexander, Thomas Larsen, Eli Lifland, Romeo Dean)Apr 3, 2025
We predict that the impact of superhuman AI over the next decade will be enormous, exceeding that of the Industrial Revolution.
Changes
StatusNov 20, 2026
Daniel Kokotajlo's quote was published: picked by the model; Unverified until a person checks it
About this quote