Skip to content
Quotes.

Chip Huyen quote, Jan 16, 2025

Author, AI Engineering · Jan 16, 2025 · Post, Common pitfalls when building generative AI applications

The teams with the best products I’ve seen all have human evaluation to supplement their automated evaluation.

Primary source

Words found on the source page on Sep 25, 2026.

More from Chip Huyen

Quote
These annotation guidelines can help improve the model’s instructions (if a human has a hard time following the instructions, the model will, too).Jan 16, 2025· Post
A common complaint is that agents are only good for burning through your API credits. However, if agents can be autonomous, they can save human time, making their costs worthwhile.Jan 7, 2025· Post
Compound mistakes: an agent often needs to perform multiple steps to accomplish a task, and the overall accuracy decreases as the number of steps increases. If the model’s accuracy is 95% per step, over 10 steps, the accuracy will drop to 60%, and over 100 steps, the accuracy will be only 0.6%.Jan 7, 2025· Post
Higher stakes: with access to tools, agents are capable of performing more impactful tasks, but any failure could have more severe consequences.Jan 7, 2025· Post

On the same topics

Quote
Most business AI use is the messy middle: multi-step workflows that need a smart enough model at a price a company can afford. It is the most important part of the market today, & it is where the competition is fiercest.Tomasz TunguzSep 23, 2026· Post
Every company, every enterprise, every country would become an AI company...Jensen HuangSep 15, 2026· Keynote
It’s rare to work with an unlimited token budget, but at OpenAI, that’s what all engineers, researchers, finance colleagues, and marketing folks do.Gergely OroszSep 15, 2026· Post
Even in a world that is speeding up, it takes time to make changes inside a firm, let alone across an economy.Azeem AzharSep 13, 2026· Post
AI doesn’t change the question: it creates new choices and moves the thresholds.Benedict EvansSep 3, 2026· Essay
Instead of having to create those tools one at a time, software might be dynamic, generative, free-form, and spontaneous. Massively more tasks can be automated, with massively less software.Benedict EvansSep 3, 2026· Essay
About this quote
Said by
Chip Huyen, Author, AI Engineering
Where
Common pitfalls when building generative AI applications
Topics
Enterprise-AI
Source
huyenchip.com/2025/01/16/ai-engineering-pitfalls.html

A quote is one moment, not the whole argument. Read it in context at the source.

Sources: the primary source linked on each quote, checked weekly. A quote is one moment; read the source. Logos via logo.dev; trademarks belong to their owners.

New quotes by email

Fridays, only in weeks with new on-the-record quotes from data and AI leaders.

Double opt-in. Unsubscribe any time.