Bryan Bischof

Bryan Bischof, Head of AI at Hex Magic, shares his extensive experience in data science, previously enhancing strategies at companies like Blue Bottle Coffee and Stitch Fix. He discusses the resurgence of notebooks as a user-friendly interface for AI, dubbing them 'Chat++' for their superior editing capabilities. The conversation also dives into the potential of Retrieval-Augmented Generation (RAG) in creating efficient SQL queries, and the importance of innovative design in AI tools to better serve non-technical users.

Experts from Amazon, Hex, Modal, Parlance Labs, and UC Berkeley share lessons learned from working with Large Language Models. They discuss the importance of evaluation and monitoring in LLM applications, data literacy in AI, the fine-tuning dilemma, real-world insights, and the evolving roles of data scientists and AI engineers.

Bryan Bischof, AI lead at Hex, shares insights on evaluating LLMs for reliable AI agents. Hex's unique framework enabled them to ship with confidence. Key ingredients to Hex's success include choosing the right tools, using a reactive DAG for course-correction, building user-centric evaluators, gating releases on meaningful metrics, and scrutinizing model inputs & outputs. The podcast discusses data analysis in AI engineering, agent capabilities development, efficiency in using agents at Hex, prompt engineering with GPT-4 Turbo, challenges in evaluating Language Models, and empowering non-technical experts in AI product building.

Bryan Bischof, a PhD mathematician turned AI and ML builder, has built recommendation and streaming systems for startups and taught data science. He discusses building terabyte-scale streaming inference, surprising predictive features, debugging recommendations gone wrong, experiment design to settle disputes, and why truth-seeking should guide data teams.

Explore insights from Eugene Yan, Bryan Bischof, Charles Frye, Hamel Husain, and Shreya Shankar on building end-to-end systems with LLMs, the experimentation mindset for AI products, strategies for building trust in AI, the importance of data examination, and evaluation strategies for professionals. These lessons apply broadly to data science, machine learning, and product development.