Eureka Labs leaders on AI, quotes with sources
19 quotes from Andrej Karpathy
- And I've vibe coded entire ephemeral apps just to find a single bug because why not - code is suddenly free, ephemeral, malleable, discardable after single use. Vibe coding will terraform software and alter job descriptions.
+4more from this blog
- Anthropic got this order of precedence correct and packaged CC into a delightful, minimal CLI form factor that changed what AI looks like - it's not just a website you go to like Google, it's a little spirit/ghost that "lives" on your computer.
- LLMs are emerging as a new kind of intelligence, simultaneously a lot smarter than I expected and a lot dumber than I expected.
- Training on the test set is a new art form. What does it look like to crush all the benchmarks but still not get AGI?
- We're not "evolving/growing animals", we are "summoning ghosts".
- Every quote from Andrej Karpathy
- Software 1.0 easily automates what you can specify. Software 2.0 easily automates what you can verify.
+1more from this blog
- I do, but it’s business as usual because we’re in an intelligence explosion already and have been for decades.
+8more from this podcast
- If you talk to a billion parameter model, I think in 20 years, you can have a very productive conversation.
- In my mind, education is the very difficult technical process of building ramps to knowledge.
- In my mind, this is more accurately described as the decade of agents.
- Reinforcement learning is a lot worse than I think the average person thinks.
- The reason you don’t do it today is because they just don’t work.
- The way I like to put it is you’re sucking supervision through a straw.
- We’re building ghosts or spirits or whatever people want to call it, because we’re not doing training by evolution. We’re doing training by imitation of humans and the data that they’ve put on the Internet.
- What takes the long amount of time and the way to think about it is that it’s a march of nines.
- Every quote from Andrej Karpathy
- As far as I can tell, the average person has never experienced a technological unlock this dramatic, this fast.
+2more from this blog
- Mary, Jim and Joes are experiencing the majority of the benefit, not Google or the government of the United States.
- So it strikes me as quite unique and remarkable that LLMs display a dramatic reversal of this pattern - they generate disproportionate benefit for regular people, while their impact is a lot more muted and lagging in corporations and governments.
- Every quote from Andrej Karpathy
About Eureka Labs
Across Glyph
Company facts live on companies.fru.dev.