The Stack Overflow Podcast

The Stack Overflow Podcast
undefined
Apr 17, 2024 • 42min

If everyone is building AI, why aren't more projects in production?

Exploring the challenges of AI development and production, from scaling projects to model selection. Insights on AI adoption in enterprises, managing AI models, and future trends. Highlights the launch of Stack Overflow's Overflow AI and teases upcoming episodes with MongoDB and Google Cloud Gen AI partner.
undefined
Apr 16, 2024 • 33min

How do you evaluate an LLM? Try an LLM.

Explore the challenges of evaluating Large Language Models (LLMs) in data science, emphasizing validation against a 'source of truth'. Discover techniques for improving evaluation, including custom benchmarks and prompt engineering. Delve into the risks of LLM self-evaluation and the importance of diverse synthetic data. Dive into the factors influencing model deployment decisions and maintenance considerations.
undefined
Apr 12, 2024 • 19min

Diverting more backdoor disasters

Topics include risks of using open-source software maintained by small teams, Apple's new LLM Ferret enhancing Siri's capabilities, and a user earning a Great Question badge on Stack Overflow. The podcast explores the XZ vulnerability in Linux, potential origins of cyber hacks, rising education costs in the U.S., Stack Overflow's impact on the software community, and tips for boosting reputation through open source contributions and interviewing techniques.
undefined
Apr 10, 2024 • 26min

Climbing the GenAI decision tree

Exploring AI decision-making processes, fine-tuning models, challenges in hosting generative AI, optimizing compute workloads, advantages of OpenVINO notebooks in AI technology, discussing Python errors and Stack Overflow integration with Generative AI.
undefined
Apr 9, 2024 • 20min

Want to be a great software engineer? Don’t be a jerk.

Topics include a backdoor in XZ compression utility, attributes of great software engineers, AI's impact on drug development, and audience engagement with AI trends on Stack Overflow.
undefined
Apr 5, 2024 • 23min

What a year building AI has taught Stack Overflow

Jessica, AI ethics and data platform building expert, discusses AI implementation, GPT and Transformer Architecture, community engagement, and challenges of implementing LLM's and Gennai on Stack Overflow with insights into data-driven decision making.
undefined
Apr 2, 2024 • 29min

Are long context windows the end of RAG?

Exploring the power of DBRX in AI, Sam Bankman-Fried's legal troubles, and a user earning a Lifeboat badge. Topics include LLMs' retrieval mechanisms, Bankman-Fried's sentence, and the impact of long context windows on AI models.
undefined
Mar 29, 2024 • 19min

Will antitrust suits benefit developers?

The podcast discusses how small nations profit from domain names, the US government's antitrust case against Apple, Reddit's IPO despite lack of profitability, challenges of a four-day work week, feedback on PRs, potential of AI tools in development, and the impact of AI on jobs and projects.
undefined
Mar 27, 2024 • 27min

Controlling cloud costs: Where to start, and where to go from there

Learn about cloud cost optimization, FinOps, surprise costs, and dealing with unexpected expenses. Explore the future of cloud cost optimization and the importance of good architecture in controlling costs. Discover strategies for optimizing cloud expenses through statelessness, spot instances, and commitment strategies.
undefined
Mar 26, 2024 • 27min

Data, data everywhere and not a stop to think

Discussing the challenges of data storage and security, measures of data quality for generative AI, and the role of Cribl in the data and observability space. Touching on the pros and cons of richer observability monitoring and closing remarks on the evolving data landscape.

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app