Author, AI Engineering · Jan 16, 2025 · Post, Common pitfalls when building generative AI applications
These annotation guidelines can help improve the model’s instructions (if a human has a hard time following the instructions, the model will, too).
Words found on the source page on Sep 25, 2026.
| Quote | |||
|---|---|---|---|
| Jan 16, 2025 | The teams with the best products I’ve seen all have human evaluation to supplement their automated evaluation.Jan 16, 2025· Post | PostCommon pitfalls when building generative AI applications | Source |
| Jan 7, 2025 | A common complaint is that agents are only good for burning through your API credits. However, if agents can be autonomous, they can save human time, making their costs worthwhile.Jan 7, 2025· Post | PostAgents | Source |
| Jan 7, 2025 | Compound mistakes: an agent often needs to perform multiple steps to accomplish a task, and the overall accuracy decreases as the number of steps increases. If the model’s accuracy is 95% per step, over 10 steps, the accuracy will drop to 60%, and over 100 steps, the accuracy will be only 0.6%.Jan 7, 2025· Post | PostAgents | Source |
| Jan 7, 2025 | Higher stakes: with access to tools, agents are capable of performing more impactful tasks, but any failure could have more severe consequences.Jan 7, 2025· Post | PostAgents | Source |
A quote is one moment, not the whole argument. Read it in context at the source.
Sources: the primary source linked on each quote, checked weekly. A quote is one moment; read the source. Logos via logo.dev; trademarks belong to their owners.
Fridays, only in weeks with new on-the-record quotes from data and AI leaders.
