Mixture of Experts

IBM
undefined
Aug 16, 2024 • 23min

Episode 16: Cost of a Data Breach 2024 and OpenAI's Project Strawberry

Is OpenAI about to release their biggest AI project? In Episode 16 of Mixture of Experts, host Tim Hwang is joined by Nathalie Baracaldo, Kate Soule, and Shobhit Varshney. Today, the experts chat IBM’s 2024 Cost of a Data Breach Report and analyze how gen AI could reduce the cost of cyber threats. Next, rumors are circulating the internet about OpenAI dropping “Project Strawberry,” what they internally reference as a “level 2” model. Are the rumors true? Tune-in for more.The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.Segments:0:01 — Intro00:52 — Cost of a Data Breach 202412:33— Project Strawberry
undefined
Aug 9, 2024 • 32min

Episode 15: OpenAI Structured Outputs, character.ai “acquisition,” and is it an AI bubble?

Marina Danilevsky, an AI development expert, joins seasoned analyst Kush Varshney and stock market guru Shobhit Varshney in a riveting discussion. They tackle whether we’re in an AI bubble and its connection to recent market crashes. The trio dives into OpenAI's Structured Outputs and their transformative potential for enterprise applications. They also dissect Google's intriguing move to 'acquire' character.ai, pondering the implications for the tech landscape and startup culture. It's a compelling exploration of tech innovation and economic shifts!
undefined
Aug 2, 2024 • 29min

Episode 14: SAM 2, friend.com and will gen AI projects be abandoned?

Meta releases SAM 2! In Episode 14 of Mixture of Experts, host Tim Hwang is joined by Ambhi Ganesan, Kate Soule and Vagner Santana. Today, the experts chat the next generation of Meta’s Segment Anything Model (SAM). Then, another AI companion attempt via friend.com, we analyze if startups effectively compete in the AI hardware space. Finally, we get expert opinions on various topics: Will gen AI projects be abandoned? Which is bigger—9.11 or 9.9? Tune-in today to find out.0:01 — Intro1:00 — SAM 210:49 — Friend.com20:53 — Abandoned gen AI projects25:38 — Which is bigger—9.11 or 9.9?The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
undefined
Jul 26, 2024 • 20min

Episode 13: Meta's Llama 3.1, Mistral Large 2, and big interest in small models

Meta strikes back with the launch of Llama 3.1! In Episode 13 of Mixture of Experts, host Tim Hwang is joined by Chris Hay, Shobhit Varshney, and Maryam Ashoori. Today, the experts analyze the business of AI in relation to the launch of Llama 3.1, including Llama 405B. Then, Mistral Large 2 sparks conversation about the open-source wave. Finally, the experts talk GPT 4o-mini and the model price war. Are little models having their moment? Tune-in to find out.0:01 — Intro1:33 — Llama 3.1 and Mistral Large 210:08 — Are Little Models Having a Moment?The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
undefined
Jul 19, 2024 • 31min

Episode 12: Goldman Sachs Gen AI report, Claude 2.0 Engineer, and RIAA lawsuits

Tech expert Chris Hay, software engineer Marina Danilevsky, and legal expert Brent Smolinski discuss Goldman Sachs' Gen AI report, Cloud Engineer 2.0, RIAA lawsuits. They delve into costs vs benefits of AI, coding agents, and legal implications of generative music AI. Will modern AI disrupt the music industry?
undefined
Jul 12, 2024 • 41min

Episode 11: AI at Wimbledon, ChatGPT for coding, and scaling with AI personas

It's Wimbledon finals week! In Episode 11 of Mixture of Experts, host Tim Hwang is joined by Aaron Baughman, Kaoutar El Maghraoui, and Skyler Speakman. Today, we review how AI is providing insights throughout one of the most prestigious tennis tournaments and the future of AI in sports. Next, the experts break down the quality of ChatGPT for coding. Finally, how did scaling synthetic data create one billion personas?The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
undefined
Jul 3, 2024 • 38min

Episode 10: AI Hardware: Training, Inference, Devices and Model Optimization

In Episode 10 of Mixture of Experts we are talking all hardware all the time. Guest host Bryan Casey is joined by Volkmar Uhlig, Chris Hay, and Kaoutar El Maghraoui to explore the intricacies of AI hardware. Is Apple creating a pattern for the industry with their on device and cloud architecture? Tune in to hear the experts debate the details.The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
undefined
Jun 28, 2024 • 39min

Episode 9: Claude 3.5 Sonnet, BIRD-SQL, and the latest in AI Slop

Is shrimp Jesus the best use case of AI content creation? In Episode 9 of Mixture of Experts, guest host Bryan Casey is joined by Shobhit Varshney, Marina Danilevsky, and Michael Glass. The experts analyze both the release Anthropic’s Claude 3.5 and BIRD-SQL. Finally, we talk the latest in AI slop and how it is affecting content creation.The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
undefined
Jun 21, 2024 • 44min

Episode 8: NVIDIA’s Nemotron-4 340B models, Safe Superintelligence Inc. and AI agents

Is there a new major player in the AI space? In Episode 8 of Mixture of Experts, host Tim Hwang is joined by Kush Varshney, Kate Soule, and Maya Murad. First, the experts react to NVIDIA’s Nemotron-4 340B model launch and the future of LLM training. Next, new developments in enterprise agents create a great discussion around the reality of AI agents. Finally, we discuss the launch of a new AI company, Safe Superintelligence Inc. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
undefined
Jun 14, 2024 • 40min

Apple's WWDC24 reactions and mechanistic interpretability

Is Apple late to the AI game? In Episode 7 of Mixture of Experts, host Tim Hwang is joined by Shobhit Varshney, Skyler Speakman, and Kaoutar El Maghraoui. Today, the experts react to Apple’s slew of AI announcements at WWDC24. Then, part 2 on interpretability this week, as OpenAI released their study mechanistic interpretability. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app