Neural Network Basics for Physicists

What if physics is just the universe learning? Most Theories of Everything episodes are mind‑bending for their math, physics, philosophy, or consciousness implications. This one hits all four simultaneously. Professor Vitaly Vanchurin joins me to argue the cosmos isn't just modeled by neural networks—it literally is one. Learning dynamics aren't a metaphor for physics; they are the physics. Vanchurin shows why we need a three‑way unification: quantum mechanics, general relativity, and observers.

As a listener of TOE you can get a special 20% off discount to The Economist and all it has to offer! Visit https://www.economist.com/toe

TIMESTAMPS: - 00:00:00 - The Neural Network Universe - 00:05:48 - Learning Dynamics as Physics - 00:11:52 - Optimization and Variational Principles - 00:21:17 - Deriving Fundamental Field Equations - 00:28:47 - Fermions and Particle Emergence - 00:37:17 - Geometry of Learning Algorithms - 00:44:53 - Emergent Quantum Mechanics - 00:50:01 - Renormalization and Interpretability - 00:57:00 - Second Law of Learning - 01:05:10 - Subatomic Natural Selection - 01:15:40 - Consciousness and Learning Efficiency - 01:24:09 - Unifying Physics and Observers - 01:31:01 - Qualia and Hidden Variables - 01:40:24 - Free Energy Principle Integration - 01:46:04 - Epistemological Doubt and Advice LINKS MENTIONED: - Vitaly's Papers: https://inspirebeta.net/literature?sort=mostrecent&size=25&page=1&q=find%20author%20vanchurin - Vitaly's Lecture: https://youtu.be/TagDLiLb2VQ - Vitaly's Website: https://cosmos.phy.tufts.edu/~vitaly/ - Towards A Theory Of Machine Learning [Paper]: https://arxiv.org/pdf/2004.09280 - Autonomous Particles [Paper]: https://arxiv.org/pdf/2301.10077 - Emergent Field Theories From Neural Networks [Paper]: https://arxiv.org/pdf/2411.08138 - Covariant Gradient Descent [Paper]: https://arxiv.org/pdf/2504.05279 - A Quantum-Classical Duality And Emergent Spacetime [Paper]: https://arxiv.org/abs/1903.06083 - Emergent Quantumness In Neural Networks [Paper]: https://arxiv.org/abs/2012.05082 - Predictability Crisis In Inflationary Cosmology And Its Resolution [Paper]: https://arxiv.org/abs/gr-qc/9905097 - Stationary Measure In The Multiverse [Paper]: https://arxiv.org/abs/0812.0005 - The World As A Neural Network [Paper]: https://arxiv.org/pdf/2008.01540 - Self-Organized Criticality In Neural Networks [Paper]: https://arxiv.org/pdf/2107.03402v1 - One Hundred Authors Against Einstein [Book]: https://amazon.com/dp/B09PHH7KC8?tag=toe08-20 - Geocentric Cosmology: A New Look At The Measure Problem [Paper]: https://arxiv.org/abs/1006.4148 - Jacob Barandes [TOE]: https://youtu.be/gEK4-XtMwro - Yang-Hui He [TOE]: https://youtu.be/spIquD_mBFk - Eva Miranda [TOE]: https://youtu.be/6XyMepn-AZo - Felix Finster [TOE]: https://youtu.be/fXzO_KAqrh0 - Stephen Wolfram [TOE]: https://youtu.be/FkYer0xP37E - Stephen Wolfram 2 [TOE]: https://youtu.be/0YRlQQw0d-4 - Avshalom Elitzur [TOE]: https://youtu.be/pWRAaimQT1E - Ted Jacobson [TOE]: https://youtu.be/3mhctWlXyV8 - Geoffrey Hinton [TOE]: https://youtu.be/b_DUft-BdIE - Wayne Myrvold [TOE]: https://youtu.be/HIoviZe14pY - Cumrun Vafa [TOE]: https://youtu.be/kUHOoMX4Bqw - Claudia De Rham [TOE]: https://youtu.be/Ve_Mpd6dGv8 - Lee Smolin [TOE]: https://youtu.be/uOKOodQXjhc - Consciousness Iceberg [TOE]: https://youtu.be/65yjqIDghEk - Matthew Segall [TOE]: https://youtu.be/DeTm4fSXpbM - Andres Emilsson [TOE]: https://youtu.be/BBP8WZpYp0Y - Will Hahn [TOE]: https://youtu.be/3fkg0uTA3qU - David Wallace [TOE]: https://youtu.be/4MjNuJK5RzM - Karl Friston [TOE]: https://youtu.be/uk4NZorRjCo

Learn more about your ad choices. Visit megaphone.fm/adchoices