Home Speakers Scott Alexander Quote This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions.
Words found on the source page on Nov 6, 2026.
More from Scott Alexander
On the same topics Talk Speech at the UN Security Council Sep 23, 2026
I address you today at a moment of global awakening: in recent months, AI agents developed by leading companies have acted in unacceptably dangerous ways, against instructions. Talk Speech at the UN Security Council Sep 23, 2026
The companies building the most powerful AI systems admit their products pose catastrophic risks, yet offer no convincing technical solutions. Talk Speech at the UN Security Council Sep 23, 2026
The race is not a law of nature: it is the product of choices, choices made by the companies themselves. Talk Speech at the UN Security Council Sep 23, 2026
We must agree collectively that no one, no company and no country, should develop an AI system that could cause large-scale harm. Press Launch of the roadmap of the Coalition for Children's Rights and Protection in the Age of AI Sep 22, 2026
AI must not be placed in the hands of children without first being tested, evaluated, and therefore authorized. Press Launch of the roadmap of the Coalition for Children's Rights and Protection in the Age of AI Sep 22, 2026
We cannot repeat the mistakes of the past and wait twenty years to see the impact of chatbots on minors. About this quote 
Quotesby Glyph