FinOps for AI and token cost management

This week, we discuss NVIDIA GTC, token machines, token budgets, and an AWS outage that may or may not involve AI. Plus, Matt reviews The Wizard of Oz at The Sphere.

Watch the YouTube Live Recording of Episode 564

Runner-up Titles

• Let's T this up.
• One Trillion Dollars
• Leader to laggard
• My terms of service
• Someone should come up with a term
• Networking FOMO
• Slide crimes
• It’s token machines all the way down.
• The Claude-ning
• So why Nemo Cloud?
• You’re just selling token machines
• Billionaire version of Gallagher
• I’ve seen too much
• Upward Replicability

Rundown

• NVIDA GTC
  • Nvidia bets on AI inference as chip revenue opportunity hits $1 trillion
  • Nvidia CEO Jensen Huang: $1 trillion in chip sales coming
  • Keynote at NVIDIA GTC San Jose 2026
• AI Roundup
  • Amazon just called an emergency engineering meeting after AI coding tools caused multiple outages.
  • 2 Ways to Correct the Financial Times at AWS (So Far)
  • Amazon orders 90-day reset after code mishaps cause millions of lost orders
  • Microsoft shakes up Copilot AI leadership team, freeing up Suleyman to build new models
  • MCP vs. CLI for AI-native development - CircleCI

Relevant to your Interests

• YouTube Lays Claim to Another Crown: The World’s Largest Media Company
• The Lobster That Moved $50 Billion
• Amazon is determined to use AI for everything – even when it slows down work
• Google Fiber will be sold to private equity firm and merge with cable company
• How to Do Code Reviews in the Agentic Era
• Elon Musk Says He's Epically Screwed Up at xAI, Is Rebuilding "From the Foundations"
• The ‘AI-Washing’ of Job Cuts Is Corrosive and Confusing
• Introducing Chainguard Commercial Builds: Secure-by-default containers
• Exclusive: Small publishers hit hardest by search traffic declines
• The State of AI in the Enterprise - 2026 AI report
• Agents Over Bubbles
• "Yes, AI Is a Bubble. There Is No Question."

Listener Feedback

• Recap of SCALE 23x with Barton George

Conferences

• KubeCon EU, March 23-26, 2026 - Coté will be there on a media pass.
• DevOpsdays Atlanta 2026, April 21-22, 2026
• DevOpsDays Austin, May 5-6, 2026
• WeAreDevelopers, July 8-10, 2026 Berlin, Coté speaking.
• VMware User Groups (VMUGs):
  • Minneapolis (April 7-9, 2026)
  • Toronto (May 12-14, 2026)
  • Dallas (June 9-11, 2026)
  • Orlando (October 20-22, 2026)

SDT News & Community

• Join our Slack community
• Email the show: questions@softwaredefinedtalk.com
• Free stickers: Email your address to stickers@softwaredefinedtalk.com
• Follow us on social media: Twitter, Threads, Mastodon, LinkedIn, BlueSky
• Watch us on: Twitch, YouTube, Instagram, TikTok
• Book offer: Use code SDT for $20 off "Digital WTF" by Coté
• Sponsor the show
• Sponsor more podcasts with Failover Media

Recommendations

• Brandon:
  • Failover Media Newsletter
  • Stitch - Design with AI
  • Milestone iOS App
  • Claude Command: /insights
• Matt:
  • Caleb Sasser XOXO 2024
  • The McDonald’s Centralia Mural
  • MPC app
• Coté:
  • Dream Router 7