MuPy: Multi-Agent Reinforcement Learning Paper

In this conversation, we explore the nature of intelligence and life itself with Blaise Agüera y Arcas, VP and Fellow at Google and head of the Paradigms of Intelligence Lab. Blaise discusses his ambitious new book "What Is Intelligence?"—a work that bridges evolutionary biology, complexity science, artificial life, and AI to argue that intelligence fundamentally arises from computation, symbiosis, and the recursive modeling of minds.Blaise describes himself as "an inch deep with a few deeper wells" across disciplines, drawing from sources as diverse as Nick Lane's work on energetics, Darwin's evolution, and anarcho-communist Peter Kropotkin's 1910 treatise on mutual aid. This intellectual breadth allows him to see connections others miss—like recognizing that the urgent questions raised by modern AI models exhibiting general intelligence without any "magical discovery" demand we fundamentally rethink what intelligence means across all substrates.Key themes we explore:- Symbiogenesis, Not Just Symbiosis: Why the distinction matters—when mutualism creates something new that reproduces as a unit, with individuals no longer viable alone- Humans as Existing Cyborgs: How the steam engine represents our "mitochondrion," enabling 7 of 8 billion people to exist by metabolizing energy on our behalf- The Endless Frontier of Intelligence: Why energy budgets increasingly shift toward thought as systems scale—and why this demand is "bottomless"- Theory of Mind as Foundation: How recursive modeling of others' minds enables social coordination and represents the mathematical basis for multi-agent learning- Artificial Life's Emergence: Why massive parallel computation will finally allow artificial life research to flourish- Categories as Approximations: Moving beyond both essentialist categorization and postmodern rejection toward understanding statistical descriptions with limits- Planetary Consciousness as Survival: Why modeling the entire ecological system isn't "woo-woo" but literally what we need for collective agencyBlaise Agüera y Arcas is a VP and Fellow at Google, where he is the CTO of Technology & Society and founder of Paradigms of Intelligence (Pi). Pi is an organization working on basic research in AI and related fields, especially the foundations of neural computing, active inference, sociality, evolution, and Artificial Life. A frequent public speaker, he has given multiple TED talks and keynoted NeurIPS. He has also authored numerous papers, essays, op-eds, and chapters, as well as two previous books, Who Are We Now? and Ubi Sunt. His most recent book, What Is Life?, is part 1 of the larger book What Is Intelligence?, forthcoming from Antikythera and MIT Press in September 2025.