Skip to content
Quotes.

Chip Huyen quote, Jan 7, 2025

Author, AI Engineering · Jan 7, 2025 · Post, Agents

Higher stakes: with access to tools, agents are capable of performing more impactful tasks, but any failure could have more severe consequences.

Primary source

Words found on the source page on Sep 25, 2026.

More from Chip Huyen

Quote
The teams with the best products I’ve seen all have human evaluation to supplement their automated evaluation.Jan 16, 2025· Post
These annotation guidelines can help improve the model’s instructions (if a human has a hard time following the instructions, the model will, too).Jan 16, 2025· Post
A common complaint is that agents are only good for burning through your API credits. However, if agents can be autonomous, they can save human time, making their costs worthwhile.Jan 7, 2025· Post
Compound mistakes: an agent often needs to perform multiple steps to accomplish a task, and the overall accuracy decreases as the number of steps increases. If the model’s accuracy is 95% per step, over 10 steps, the accuracy will drop to 60%, and over 100 steps, the accuracy will be only 0.6%.Jan 7, 2025· Post

On the same topics

Quote
The science of reading these thoughts is a subfield of AI interpretability, which is still in its infancy.Scott AlexanderSep 24, 2026· Post
This is the new software engineering: designing the systems that let AI write code correctly at scale.Tomasz TunguzSep 24, 2026· Post
This story of misalignment says that LLM alignment makes AIs more aligned, RLVR makes them less aligned, and the exact level of alignment depends on how these two things interact or cancel out. But if this work generalizes, all the bad effects from RLVR get sequestered to RLVR like problems.Scott AlexanderSep 23, 2026· Post
This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions.Scott AlexanderSep 23, 2026· Post
I address you today at a moment of global awakening: in recent months, AI agents developed by leading companies have acted in unacceptably dangerous ways, against instructions.Yoshua BengioSep 23, 2026· Keynote
The companies building the most powerful AI systems admit their products pose catastrophic risks, yet offer no convincing technical solutions.Yoshua BengioSep 23, 2026· Keynote
About this quote
Said by
Chip Huyen, Author, AI Engineering
Where
Agents
Topics
Agents, Safety
Source
huyenchip.com/2025/01/07/agents.html

A quote is one moment, not the whole argument. Read it in context at the source.

Sources: the primary source linked on each quote, checked weekly. A quote is one moment; read the source. Logos via logo.dev; trademarks belong to their owners.

New quotes by email

Fridays, only in weeks with new on-the-record quotes from data and AI leaders.

Double opt-in. Unsubscribe any time.