My worry is that AI systems are both better at coordinating than humans and also much, much faster moving than us.
Words found on the source page on Nov 6, 2026.
More from Jack Clark
BlogImport AI 471: Why Hugging Face worriesAug 31, 2026
This means that space mining is a perfect business opportunity for superintelligences that come online - perhaps by 2033 we will see AI-run asteroid mining corporations, bidding on contracts that human-supervised companies are not willing to pursue, due to risk or complexity.TalkImport AI 458 / 2026 Cosmos HAI Lab Lecture, OxfordMay 26, 2026
It’s time to plan for this, because AI systems are likely to get better a lot faster than people expect, and as they become more advanced we should expect profound changes to happen to people and to society.TalkImport AI 458 / 2026 Cosmos HAI Lab Lecture, OxfordMay 26, 2026
That class of technology has never existed before, and yet I believe this could happen within the next two years, and possibly sooner.TalkImport AI 458 / 2026 Cosmos HAI Lab Lecture, OxfordMay 26, 2026
This significant increase in the automation of coding has been equivalent to dropping many, many more employees into Anthropic, speeding up our overall pace of development.TalkImport AI 458 / 2026 Cosmos HAI Lab Lecture, OxfordMay 26, 2026
We might soon be able to build an AI system that may be smart enough to develop its own successor, thus kicking off a process of recursive self-improvement which would utterly transform the economy and the broader world.TalkImport AI 458 / 2026 Cosmos HAI Lab Lecture, OxfordMay 26, 2026
When I look at the graph, I feel a sense of vertigo, because I know a little bit about what underlies this graph.BlogImport AI 456: RSI and economic growthMay 11, 2026
The surprising thing from my perspective is seeing the feedback across the whole economy, suggesting we might hit an ‘economic singularity’ as a consequence of broad diffusion of automation technologies into the economy.BlogImport AI 456: RSI and economic growthMay 11, 2026
This paper points to a future where we get rid of all the software underpinning computers in a traditional sense and just replace it with a gigantic neural network.
On the same topics
BlogWill agents have network effects?Oct 6, 2026
If the content creation loop works for agentic virality, I think it means there’s a big incentive for every agent to volunteer to make visually-appealing, shareable content, do this often.UnverifiedBlogThe Specter Of NeuraleseSep 24, 2026
The science of reading these thoughts is a subfield of AI interpretability, which is still in its infancy.BlogThinking in Systems, Shipping in LoopsSep 24, 2026
This is the new software engineering: designing the systems that let AI write code correctly at scale.BlogMysteries Of AI GeneralizationSep 23, 2026
This story of misalignment says that LLM alignment makes AIs more aligned, RLVR makes them less aligned, and the exact level of alignment depends on how these two things interact or cancel out. But if this work generalizes, all the bad effects from RLVR get sequestered to RLVR like problems.BlogMysteries Of AI GeneralizationSep 23, 2026
This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions.TalkSpeech at the UN Security CouncilSep 23, 2026
I address you today at a moment of global awakening: in recent months, AI agents developed by leading companies have acted in unacceptably dangerous ways, against instructions.
About this quote
Quotesby Glyph