Designing Scalable AI Systems with FastMCP: Challenges and Innovations

86 snips

Aug 26, 2025

Jeremiah Lowin, the founder and CEO of Prefect Technologies, discusses the FastMCP framework, designed to streamline AI tool deployment. He shares insights on the evolution of FastMCP and its role in simplifying the design of MCP servers. The conversation delves into the importance of context engineering and the challenges of authentication in AI systems. Jeremiah emphasizes the need for simplicity in development and addresses potential limitations of FastMCP, while exploring future innovations in the AI landscape.

Ask episode

AI Snips

Chapters

Transcript

Episode notes

INSIGHT

Python Functions Offer A Stable Path

Mapping Python functions to MCP tools provides a reliable success path because function signatures and docstrings translate well.
Edge cases arise with complex structured arguments and client implementations that serialize unexpectedly.

ADVICE

Don't Auto-Convert Full OpenAPI Specs

Avoid blindly converting large OpenAPI specs into MCP servers because discovery payloads will explode token context and break agents.
Curate and compress tool surfaces instead of auto-exposing every REST endpoint.

ADVICE

Expose MCP Route In Web Apps

Integrate FastMCP into ASGI apps (FastAPI) by exposing a dedicated /mcp route to serve agentic clients while keeping REST for programmatic clients.
Use the SDK's ASGI wrapping utilities and follow lifecycle docs to avoid server issues.

Get the Snipd Podcast app to discover more snips from this episode

Get the app

Summary
In this episode of the AI Engineering Podcast Jeremiah Lowin, founder and CEO of Prefect Technologies, talks about the FastMCP framework and the design of MCP servers. Jeremiah explains the evolution of FastMCP, from its initial creation as a simpler alternative to the MCP SDK to its current role in facilitating the deployment of AI tools. The discussion covers the complexities of designing MCP servers, the importance of context engineering, and the potential pitfalls of overwhelming AI agents with too many tools. Jeremiah also highlights the importance of simplicity and incremental adoption in software design, and shares insights into the future of MCP and the broader AI ecosystem. The episode concludes with a look at the challenges of authentication and authorization in AI applications and the exciting potential of MCP as a protocol for the future of AI-driven business logic.

Announcements

Hello and welcome to the AI Engineering Podcast, your guide to the fast-moving world of building scalable and maintainable AI systems
Your host is Tobias Macey and today I'm interviewing Jeremiah Lowin about the FastMCP framework and how to design and build your own MCP servers

Interview

Introduction
How did you get involved in machine learning?
Can you start by describing what MCP is and its purpose in the ecosystem of AI applications?
What is FastMCP and what motivated you to create it?
- Recognizing that MCP is relatively young, how would you characterize the landscape of MCP frameworks?
What are some of the stumbling blocks on the path to building a well engineered MCP server?
- What are the potential ramifications of poorly designed and implemented MCP implementations?
In the overall context of an AI-powered/agentic application, what are the tradeoffs of investing in the MCP protocol? (e.g. engineering effort, process isolation, tool creation, auth(n|z), etc.)
- In your experience, what are the architectural patterns that you see of MCP implementation and usage?
There are a multitude of MCP servers available for a variety of use cases. What are the key factors that someone should be using to evaluate their viability for a production use case?
Can you give an overview of the key characteristics of FastMCP and why someone might select it as their implementation target for a custom MCP server?
- How have the design, scope, and goals of the project evolved since you first started working on it?
For someone who is using FastMCP as the framework for creating their own AI tools, what are some of the design considerations or best practices that they should be aware of?
- What are some of the ways that someone might consider integrating FastMCP into their existing Python-powered web applications (e.g. FastAPI, Django, Flask, etc.)
As you continue to invest your time and energy into FastMCP, what is your overall goal for the project?
What are the most interesting, innovative, or unexpected ways that you have seen FastMCP used?
What are the most interesting, unexpected, or challenging lessons that you have learned while working on FastMCP?
When is FastMCP the wrong choice?
What do you have planned for the future of FastMCP?

Contact Info

Parting Question

From your perspective, what are the biggest gaps in tooling, technology, or training for AI systems today?

Closing Announcements

Thank you for listening! Don't forget to check out our other shows. The Data Engineering Podcast covers the latest on modern data management. Podcast.__init__ covers the Python language, its community, and the innovative ways it is being used.
Visit the site to subscribe to the show, sign up for the mailing list, and read the show notes.
If you've learned something or tried out a project from the show then tell us about it! Email hosts@aiengineeringpodcast.com with your story.
To help other people find the show please leave a review on iTunes and tell your friends and co-workers.

Links

The intro and outro music is from Hitman's Lovesong feat. Paola Graziano by The Freak Fandango Orchestra/CC BY-SA 3.0