In this episode of Building With AI, host Haroon Choudery is joined by Jason Liu, a seasoned AI operator and consultant who advises seed-stage start-ups on tech strategy, research, and infrastructure.

With several years of experience in machine learning, Jason has gained recognition for creating AI-specific dev tooling and contributing to several open-source projects.

During the conversation, they discuss:

General applications vs. AI applications,
How developers should work with LLMs,
What LLMOps companies need to focus on,
Why saying 'no' can improve your AI's success rate,
Building agile AI systems,
Best practices for RAG systems,
And much more!

—

[00:00] Up next: Jason Liu

[00:25] Episode Introduction

[01:12] Autoblocks: AI Optimization Platform

[02:07] Jason's introduction

[03:44] General applications vs. AI applications

[05:08] The two categories of dev tools

[06:43] The AI landscape for non-technical users

[08:47] The one skill developers need

[09:57] The eval puzzle

[11:52] What LLMOps companies need to focus on

[16:26] Why saying 'no' can improve your AI's success rate

[18:15] How can you build an agile AI system?

[21:41] Strategies for building products that stick

[24:29] Similarities between RAG and recommendation frameworks

[26:03] Best practices for RAG systems

[28:27] The importance of short-term metrics

[29:30] Data strategies for effective RAG systems

[35:22] Jason's hottest take on AI

[36:22] Jason's future projects

—

Brought to you by Autoblocks (https://www.autoblocks.ai) — how product teams deliver better AI experiences.

—

Subscribe to Building With AI:

Website: https://www.bwai.autoblocks.ai
X: https://x.com/bwaipodcast

Where to find Jason Liu:

Linkedln: https://www.linkedin.com/in/jxnlco/
X: https://twitter.com/jxnlco

Where to find Haroon Choudery:

Linkedln: https://www.linkedin.com/in/haroonchoudery/
X: https://x.com/haroonchoudery

Learn more about Autoblocks:

Website: https://www.autoblocks.ai/
X: https://twitter.com/AutoblocksAI

Power Players: Chargers Assistant GM Chad Alexander

NFL Daily with Gregg Rosenthal

What still excites Chad about football

The AI-powered Podcast Player