Chip Huyen quotes on AI, with sources
Author, AI Engineering · 5 quotes · latest Jan 16, 2025
- The teams with the best products I’ve seen all have human evaluation to supplement their automated evaluation.
- These annotation guidelines can help improve the model’s instructions (if a human has a hard time following the instructions, the model will, too).
- A common complaint is that agents are only good for burning through your API credits. However, if agents can be autonomous, they can save human time, making their costs worthwhile.
- Compound mistakes: an agent often needs to perform multiple steps to accomplish a task, and the overall accuracy decreases as the number of steps increases. If the model’s accuracy is 95% per step, over 10 steps, the accuracy will drop to 60%, and over 100 steps, the accuracy will be only 0.6%.
- Higher stakes: with access to tools, agents are capable of performing more impactful tasks, but any failure could have more severe consequences.
About Chip Huyen
Author, AI Engineering. Listed here for public statements only; no personal details.
Photo: None found: initials only. Photos come from Wikimedia Commons or official company pages, never LinkedIn.
Topics: Enterprise AI, Agents, Safety