#162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness

107 snips

Feb 18, 2021

Jim Keller, a legendary microprocessor engineer with stints at AMD, Apple, Tesla, and more, dives into the future of computing and AI. He discusses the significance of empathy in understanding human behavior and how it influences creativity. The conversation reveals insights on the balance of craftsmanship with theoretical innovation in technology. Jim also explores the challenges in neural networks versus human cognition, the impact of love on success, and the potential for ubiquitous computing to reshape our relationship with technology.

Ask episode

AI Snips

Chapters

Transcript

Episode notes

INSIGHT

Tenstorrent's Approach

Tenstorrent aims to build hardware that natively executes graph programs.
Its two pillars are Andrej Karpathy's "Software 2.0" and Chris Lattner's MLIR.

INSIGHT

Tenstorrent's Goals

Tenstorrent aims to scale from 100 milliwatts to a megawatt, addressing various problem sizes.
They prioritize basic functionality and ease of use for their customers.

INSIGHT

GPUs vs. AI Hardware

GPUs, designed for pixel-based programs, may not be ideal for graph-based AI computations.
Hardware optimized for specific operations like rasterization can significantly outperform software.

Get the Snipd Podcast app to discover more snips from this episode

Get the app

Jim Keller is a legendary microprocessor engineer, previously at AMD, Apple, Tesla, Intel, and now Tenstorrent. Please support this podcast by checking out our sponsors:
– Athletic Greens: https://athleticgreens.com/lex and use code LEX to get 1 month of fish oil
– Brooklinen: https://brooklinen.com and use code LEX to get $25 off + free shipping
– ExpressVPN: https://expressvpn.com/lexpod and use code LexPod to get 3 months free
– Belcampo: https://belcampo.com/lex and use code LEX to get 20% off first order

EPISODE LINKS:
Jim’s Twitter: https://twitter.com/jimkxa
Jim’s Wiki: https://en.wikipedia.org/wiki/Jim_Keller_(engineer)
Tenstorrent: https://www.tenstorrent.com/

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/LexFridmanPage
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(07:02) – Good design is both science and engineering
(13:03) – Javascript
(17:09) – RISC vs CISC
(21:09) – What makes a great processor?
(22:38) – Intel vs ARM
(24:27) – Steve Jobs and Apple
(27:05) – Elon Musk and Steve Jobs
(32:50) – Father
(36:33) – Perfection
(42:48) – Modular design
(48:22) – Moore’s law
(55:20) – Hardware for deep learning
(1:02:14) – Making neural networks fast at scale
(1:09:51) – Andrej Karpathy and Chris Lattner
(1:14:05) – How GPUs work
(1:18:12) – Tesla Autopilot, NVIDIA, and Mobileye
(1:22:52) – Andrej Karpathy and Software 2.0
(1:29:13) – Tesla Dojo
(1:31:49) – Neural networks will understand physics better than humans
(1:34:02) – Re-engineering the human brain
(1:38:56) – Infinite fun and the Culture Series by Iain Banks
(1:40:50) – Neuralink
(1:46:13) – Dreams
(1:50:06) – Ideas
(2:00:19) – Aliens
(2:05:16) – Jordan Peterson
(2:10:13) – Viruses
(2:13:22) – WallStreetBets and Robinhood
(2:21:25) – Advice for young people
(2:23:15) – Human condition
(2:25:43) – Fear is a cage
(2:30:34) – Love
(2:36:57) – Regrets