

Mixture of Experts
IBM
Welcome to Mixture of Experts, your weekly deep dive into the ever-evolving landscape of artificial intelligence—bringing you insightful discussions on the latest AI trends, innovations, and their impact on business. From breakthrough research to practical applications, each episode offers a balanced blend of expertise and analysis. Explore how AI is reshaping industries, driving efficiency, and unlocking new opportunities for growth. Whether you're a seasoned professional seeking to stay ahead of the curve or an enthusiast curious about the future of technology, Mixture of Experts delivers the perfect mix of insights and practical knowledge. Tune in and stay informed as we navigate the dynamic intersection of AI and business.
Episodes
Mentioned books

Aug 16, 2024 • 23min
Episode 16: Cost of a Data Breach 2024 and OpenAI's Project Strawberry
Is OpenAI about to release their biggest AI project? In Episode 16 of Mixture of Experts, host Tim Hwang is joined by Nathalie Baracaldo, Kate Soule, and Shobhit Varshney. Today, the experts chat IBM’s 2024 Cost of a Data Breach Report and analyze how gen AI could reduce the cost of cyber threats. Next, rumors are circulating the internet about OpenAI dropping “Project Strawberry,” what they internally reference as a “level 2” model. Are the rumors true? Tune-in for more.The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.Segments:0:01 — Intro00:52 — Cost of a Data Breach 202412:33— Project Strawberry

Aug 9, 2024 • 32min
Episode 15: OpenAI Structured Outputs, character.ai “acquisition,” and is it an AI bubble?
Marina Danilevsky, an AI development expert, joins seasoned analyst Kush Varshney and stock market guru Shobhit Varshney in a riveting discussion. They tackle whether we’re in an AI bubble and its connection to recent market crashes. The trio dives into OpenAI's Structured Outputs and their transformative potential for enterprise applications. They also dissect Google's intriguing move to 'acquire' character.ai, pondering the implications for the tech landscape and startup culture. It's a compelling exploration of tech innovation and economic shifts!

Aug 2, 2024 • 29min
Episode 14: SAM 2, friend.com and will gen AI projects be abandoned?
Meta releases SAM 2! In Episode 14 of Mixture of Experts, host Tim Hwang is joined by Ambhi Ganesan, Kate Soule and Vagner Santana. Today, the experts chat the next generation of Meta’s Segment Anything Model (SAM). Then, another AI companion attempt via friend.com, we analyze if startups effectively compete in the AI hardware space. Finally, we get expert opinions on various topics: Will gen AI projects be abandoned? Which is bigger—9.11 or 9.9? Tune-in today to find out.0:01 — Intro1:00 — SAM 210:49 — Friend.com20:53 — Abandoned gen AI projects25:38 — Which is bigger—9.11 or 9.9?The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Jul 26, 2024 • 20min
Episode 13: Meta's Llama 3.1, Mistral Large 2, and big interest in small models
Meta strikes back with the launch of Llama 3.1! In Episode 13 of Mixture of Experts, host Tim Hwang is joined by Chris Hay, Shobhit Varshney, and Maryam Ashoori. Today, the experts analyze the business of AI in relation to the launch of Llama 3.1, including Llama 405B. Then, Mistral Large 2 sparks conversation about the open-source wave. Finally, the experts talk GPT 4o-mini and the model price war. Are little models having their moment? Tune-in to find out.0:01 — Intro1:33 — Llama 3.1 and Mistral Large 210:08 — Are Little Models Having a Moment?The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Jul 19, 2024 • 31min
Episode 12: Goldman Sachs Gen AI report, Claude 2.0 Engineer, and RIAA lawsuits
Tech expert Chris Hay, software engineer Marina Danilevsky, and legal expert Brent Smolinski discuss Goldman Sachs' Gen AI report, Cloud Engineer 2.0, RIAA lawsuits. They delve into costs vs benefits of AI, coding agents, and legal implications of generative music AI. Will modern AI disrupt the music industry?

Jul 12, 2024 • 41min
Episode 11: AI at Wimbledon, ChatGPT for coding, and scaling with AI personas
It's Wimbledon finals week! In Episode 11 of Mixture of Experts, host Tim Hwang is joined by Aaron Baughman, Kaoutar El Maghraoui, and Skyler Speakman. Today, we review how AI is providing insights throughout one of the most prestigious tennis tournaments and the future of AI in sports. Next, the experts break down the quality of ChatGPT for coding. Finally, how did scaling synthetic data create one billion personas?The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Jul 3, 2024 • 38min
Episode 10: AI Hardware: Training, Inference, Devices and Model Optimization
In Episode 10 of Mixture of Experts we are talking all hardware all the time. Guest host Bryan Casey is joined by Volkmar Uhlig, Chris Hay, and Kaoutar El Maghraoui to explore the intricacies of AI hardware. Is Apple creating a pattern for the industry with their on device and cloud architecture? Tune in to hear the experts debate the details.The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Jun 28, 2024 • 39min
Episode 9: Claude 3.5 Sonnet, BIRD-SQL, and the latest in AI Slop
Is shrimp Jesus the best use case of AI content creation? In Episode 9 of Mixture of Experts, guest host Bryan Casey is joined by Shobhit Varshney, Marina Danilevsky, and Michael Glass. The experts analyze both the release Anthropic’s Claude 3.5 and BIRD-SQL. Finally, we talk the latest in AI slop and how it is affecting content creation.The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Jun 21, 2024 • 44min
Episode 8: NVIDIA’s Nemotron-4 340B models, Safe Superintelligence Inc. and AI agents
Is there a new major player in the AI space? In Episode 8 of Mixture of Experts, host Tim Hwang is joined by Kush Varshney, Kate Soule, and Maya Murad. First, the experts react to NVIDIA’s Nemotron-4 340B model launch and the future of LLM training. Next, new developments in enterprise agents create a great discussion around the reality of AI agents. Finally, we discuss the launch of a new AI company, Safe Superintelligence Inc. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Jun 14, 2024 • 40min
Apple's WWDC24 reactions and mechanistic interpretability
Is Apple late to the AI game? In Episode 7 of Mixture of Experts, host Tim Hwang is joined by Shobhit Varshney, Skyler Speakman, and Kaoutar El Maghraoui. Today, the experts react to Apple’s slew of AI announcements at WWDC24. Then, part 2 on interpretability this week, as OpenAI released their study mechanistic interpretability. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.


