Balancing openness with misuse risks

Much of the fear around AI centers on misalignment – the idea that powerful systems might act against human interests. Vincent Weisser worries about something different: what happens if advanced AI systems are perfectly aligned with the interests of a small group of institutions? That concern led him to co-found Prime Intellect, a startup building open infrastructure for training and deploying advanced AI models. Before Prime Intellect, Weisser helped organize Vitalik Buterin’s Zuzalu experiment and worked in decentralized science, where he helped unlock roughly $40 million in funding for unconventional research. Today, he’s applying that same open ethos to AI, working to ensure the tools that shape superintelligence remain broadly accessible rather than concentrated in the hands of a few.

—

In our conversation, we explore:

• Why Vincent believes multiple superintelligences are safer than one
• The intellectual influences that shaped Vincent’s thinking about intelligence and progress, including David Deutsch and Nick Bostrom
• Prime Intellect’s evolution from distributed compute infrastructure to frontier model training and reinforcement learning tools
• Why Vincent believes open and decentralized science could accelerate discovery
• The Zuzalu experiment and what it suggests about the future of scientific communities
• The role of aesthetics and craft in building technology
• Why Europe might have a cultural advantage in a post-superintelligence world
• Vincent’s predictions for the next five years of AI

—

Thank you to the partners who make this possible

Granola: The app that might actually make you love meetings.

Brex: The intelligent finance platform.

Rippling: Stop wasting time on admin tasks, build your startup faster.

—

Transcript: https://www.generalist.com/p/why-one-superintelligence-is-more

—

Timestamps

(00:00) Introduction to Vincent Weisser

(03:28) The book behind Prime Intellect’s name

(07:35) The case for suffering

(09:35) An overview of Prime Intellect

(13:03) Why open source models matter

(21:18) Vincent’s intellectual influences

(25:17) Early years in the startup scene

(31:48) Funding science outside traditional institutions

(41:22) The past 6 months of AI progress

(43:45) Deciding to build Prime Intellect

(46:55) Why GPUs were the right starting point

(51:39) Training models on Prime Intellect

(59:48) Why beauty matters

(1:03:48) The Zuzalu experiment

(1:06:27) Prime Intellect’s AGI Easter egg

(1:11:13) Predictions for the next five years

(1:15:09) Final meditations

—

Follow Vincent Weisser

LinkedIn: https://linkedin.com/in/vincentweisser

X: https://x.com/vincentweisser

Goodreads: https://www.goodreads.com/user/show/69248416-vincent-weisser

Website: https://primeintellect.ai

—

Resources and episode mentions: https://www.generalist.com/p/why-one-superintelligence-is-more⁠

—

Production and marketing by penname.co. For inquiries about sponsoring the podcast, email jordan@penname.co.