Mixture of Experts Episode 43: Deep Research, OpenAI inference chip, small VLMs, and AI agent job posting
16 snips
Feb 21, 2025 
In this discussion, Kate Soule, an AI and vision language models expert from Granite, Volkmar Uhlig, who leads AI infrastructure at a major firm, and Shobhit Varshney, a senior consultant on AI in the Americas, dive into the burgeoning world of deep research in AI. They explore exciting innovations from OpenAI and Google, the prospects of an OpenAI inference chip, and the rise of smaller vision-language models. The conversation wraps up with an intriguing look at a startup's quest for AI agents, pondering their role in the job market of the future.
AI Snips
Chapters
Transcript
Episode notes
DeepSeek's Influence
- DeepSeek's R1 model, showcasing impressive reasoning capabilities, influenced the market.
- OpenAI's deep research, using the O3 reasoning model, followed, prompting other companies to develop similar features.
Winning at Deep Research
- To excel in deep research, focus on connecting information effectively and providing accurate citations.
- Speed is less crucial than insightful synthesis and proper attribution.
Evaluation Challenges
- Evaluating deep research outputs is challenging due to the lack of verifiable benchmarks.
- Comparing accuracy and determining "good" research remains subjective and complex.