The Future of Content Delivery Networks and Streaming QoE, with Jason Thibeault

Matt Levine chats with Jason Thibeault, the Executive Director of the Streaming Video Technology Alliance, a global consortium of companies working to shape the future of online video.

They discuss why CDN performance issues persist even as edge delivery improves, and how blind spots in the middle mile and misleading metrics continue to cause outages, buffering, and viewer churn. Jason shares insights on how better visibility, smarter metrics, and emerging AI-driven workflows can help streaming teams diagnose problems faster, reduce viewer attrition, and build more resilient delivery strategies.

• Jason explains why edge capacity alone is not enough to guarantee CDN performance. He highlights that the real challenge is the middle mile and managing link saturation between networks. Learning to identify these bottlenecks can improve the reliability of a streaming service.
• Jason covers how cache hit rate statistics can be misleading. He emphasizes that knowing who is fetching what and how large the content is matters more than simple percentages.
• Learn the importance of end-to-end visibility across the delivery chain. Without understanding how a user session flows from CDN to ISP, diagnosing performance problems is nearly impossible.
• Jason shares why big streamers like Netflix invest in in-house CDNs. It's all about control, not cost savings. Owning the cache gives them authority over content placement and delivery quality.
• Jason explains how agentic AI workflows are starting to transform streaming operations. Multiple agents trained on specific LLMs can analyze logs and suggest the top probable issues in minutes. This allows teams to focus on resolving problems faster and more accurately.
• Matt reveals why deploying more edge caches everywhere is not always efficient. He demonstrates that there is a diminishing return when you spread storage too thin across multiple locations. Knowing how to balance cache distribution can maximize performance without overspending.
• How CDNs need better visibility into real-time link capacity. Operators currently lack insight into which links are saturated, making it hard to reroute traffic effectively.
• Jason explains why customer experience is the real measure of CDN success. He stresses that a cache hit percentage does not always correlate with reduced viewer complaints. Focusing on metrics like rebuffer rate and session quality gives a clearer picture.
• Jason covers the economic implications of caching strategies. He explains that caching everything everywhere requires excessive storage and capital, which is not practical. Learning to prioritize popular content ensures efficiency and cost control.
• Matt and Jason agree that two CDNs with similar cache hit rates can have vastly different impacts on origin requests. This highlights the need for more granular monitoring.
• Jason shares why streaming operators should prioritize problem-solving over hype-driven AI projects. He mentions that automated captions and image generation are interesting but not essential. Real gains come from using AI to prevent viewer attrition and improve QoE.
• Jason explains how session-level tracing can reveal hidden performance issues. By correlating logs across CDNs and ISPs, operators can pinpoint the source of rebuffering. This approach allows faster remediation and better user experience.
• Learn why generalists struggle to make sense of complex performance data. Developing deep knowledge in one area allows teams to interface effectively with AI agents and networks.
• Jason shares how modern CDNs must adapt to cyclical network congestion. He explains that even with perfect caching, problems occur when ISPs experience sudden load spikes. Planning for these scenarios ensures more consistent delivery.
• Jason explains that building a CDN is easy, but operating it 24-7-365 is the real challenge. He compares it to leasing a freighter versus running a global delivery network. This perspective helps new operators understand the operational complexity of content delivery.

Jason Thibeault on LinkedIn

theanycast.com/s3e2