Skip to content
Quotes.

Shawn Wang (swyx) quote, Jun 30, 2023

Editor, Latent Space · Jun 30, 2023 · Essay, The Rise of the AI Engineer

Foundation Models are “ few shot learners ”, exhibiting in-context learning and even zero shot transfer capabilities that generalize beyond the original intent of model trainers. In other words, the people creating the models don’t fully know what they are capable of.

Primary source

Words found on the source page on Sep 25, 2026.

More from Shawn Wang (swyx)

Quote
I think software engineering will spawn a new subdiscipline, specializing in applications of AI and wielding the emerging stack effectively, just as “ site reliability engineer ”, “ devops engineer ”, “ data engineer ” and “ analytics engineer ” emerged.Jun 30, 2023· Essay
In the near future, nobody will recommend starting in AI Engineering by reading Attention is All You Need, just like you do not start driving by reading the schematics for the Ford Model T.Jun 30, 2023· Essay
There are 10x as many ML Engineer jobs as AI Engineer jobs on Indeed, but the higher growth rate of “AI” leads me to predict that this ratio will invert in 5 years.Jun 30, 2023· Essay
We are observing a once in a generation “shift right” of applied AI, fueled by the emergent capabilities and open source/API availability of Foundation Models. A wide range of AI tasks that used to take 5 years and a research team to accomplish in 2013, now just require API docs and a spare afternoon in 2023.Jun 30, 2023· Essay

On the same topics

Quote
An AI with more real layers can actually be “smarter” in the conventional sense of the term.Scott AlexanderSep 24, 2026· Post
For 100 steps in a row, the AI can shoot delicate subtle ideas from layer to layer at the speed of light. Then there’s one step where it has to encode them into twenty-six glyphs invented by Phoenician turquoise miners in 1800 BC. Then it has to re-encode the Phoenician glyphs into delicate subtle lightspeed ideas before it can do anything else.Scott AlexanderSep 24, 2026· Post
The science of reading these thoughts is a subfield of AI interpretability, which is still in its infancy.Scott AlexanderSep 24, 2026· Post
This trains the AIs to be focused on task success, which naturally risks including things like reward-hacking, cheating, and single-minded pursuit of stated goals at the expense of ethical injunctions.Scott AlexanderSep 23, 2026· Post
It is important to not confuse massive steps in inference-time scaling, a dynamic which should be fairly predictable, with being the outputs of RSI, which is highly uncertain.Nathan LambertSep 19, 2026· Post
If you have five hours, you’re probably going to do a lot better. The AI models are pretty similar.Noam BrownSep 17, 2026· Interview
About this quote
Said by
Shawn Wang (swyx), Editor, Latent Space
Where
The Rise of the AI Engineer
Topics
Research
Company
Latent Space
Source
latent.space/p/ai-engineer

A quote is one moment, not the whole argument. Read it in context at the source.

Sources: the primary source linked on each quote, checked weekly. A quote is one moment; read the source. Logos via logo.dev; trademarks belong to their owners.

New quotes by email

Fridays, only in weeks with new on-the-record quotes from data and AI leaders.

Double opt-in. Unsubscribe any time.