Training Data Andrej Karpathy: From Vibe Coding to Agentic Engineering
588 snips
Apr 30, 2026 
Andrej Karpathy, AI researcher who co-founded OpenAI and led AI at Tesla, now runs Eureka Labs. He unpacks why vibe coding felt revolutionary and why agentic engineering is the rigorous follow-up. He reframes LLMs as jagged, summoned “ghosts,” explores Software 3.0 and verifiability, and explains which human skills—judgment and understanding—stay essential.
AI Snips
Chapters
Transcript
Episode notes
Software 3.0 Means Prompting Becomes Programming
- Karpathy frames Software 3.0 as programming via prompts where the context window is the lever over an LLM interpreter.
- Example: installing OpenClaw becomes copying a prompt to an agent that inspects the environment, debugs, and performs installation rather than a complex shell script.
How Gemini Made Karpathy's Menugen App Obsolete
- Karpathy built Menugen as a Vercel app that OCRs menus and generates images, then saw Gemini plus Nano Banana produce the same result from a single photo.
- He concluded his app was unnecessary in the Software 3.0 world where the model directly rendered the desired output.
Neural Nets Could Become The Host Process
- Karpathy imagines neural nets becoming the host process with CPUs as co-processors, flipping the classical compute hierarchy.
- He points to increasing FLOP spend on neural workloads as evidence that neural nets could run most heavy lifting and use tools for deterministic tasks.