Home Speakers Richard Sutton Quote In which case, it will be another instance of the bitter lesson, that the things that used human knowledge were eventually superseded by things that just trained from experience and computation.
Words found on the source page on Nov 6, 2026.
On the same topics Blog The Specter Of Neuralese Sep 24, 2026
An AI with more real layers can actually be “smarter” in the conventional sense of the term. Blog The Specter Of Neuralese Sep 24, 2026
For 100 steps in a row, the AI can shoot delicate subtle ideas from layer to layer at the speed of light. Then there’s one step where it has to encode them into twenty-six glyphs invented by Phoenician turquoise miners in 1800 BC. Then it has to re-encode the Phoenician glyphs into delicate subtle lightspeed ideas before it can do anything else. Blog The Specter Of Neuralese Sep 24, 2026
The science of reading these thoughts is a subfield of AI interpretability, which is still in its infancy. Blog Mysteries Of AI Generalization Sep 23, 2026
This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions. Blog Banning self-recursive improvement in AI models? Sep 22, 2026
If the top U.S. labs have to give up on what is supposed to be really important, they will look very “catchable.” The policy creates a big incentive for some other parts of the world to invest a lot more in compute. Blog Frontier Overhangs Sep 21, 2026
A world with sufficient compute is one where intelligence is a commodity, and in commodity markets margin comes from a superior cost structure, which I would expect the leading model providers to have, in part because they have a meaningful lead in scaling and can apply superior AI to their infrastructure. About this quote