This Week in Startups

Is Chalk.ai the ‘Next Databricks’? + Tollbit’s Bot Paywall for AI Agents | E2167

129 snips
Aug 20, 2025
Guest
Toshit Panigrahi
Guest
Marc Freed-Finnegan
Marc Freed-Finnegan, Co-founder and CEO of Chalk, discusses tackling data freshness in AI by providing real-time data pipelines that boost inference speed, positioning Chalk as a potential leader in the field. Toshit Panigrahi, CEO of Tollbit, shares insights on their innovative 'bot paywall' designed to change how AI agents access content, signaling a shift in data licensing trends. Listen in as they dive into the wrap-up on the evolving landscape of AI monetization and data accessibility, hinting at what the future holds for this dynamic industry.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
INSIGHT

RAG Is About Retrieval At Query Time

  • RAG (retrieval-augmented generation) fetches web content at query time to provide up-to-date answers, unlike one-time model training.
  • RAG is central for search, agents, and any workflow that needs current external context.
INSIGHT

Agents Multiply Web Requests Dramatically

  • Agents magnify web traffic: they read many more pages than humans and do not tire.
  • This multiplies requests and causes huge autonomous traffic volume versus human clicks.
INSIGHT

Robots.txt Is Losing Its Teeth

  • Robots.txt is an honor system and lacks enforcement, making it less effective against agent scraping.
  • The web's old norms break down when autonomous agents scale and ignore nonbinding rules.
Get the Snipd Podcast app to discover more snips from this episode
Get the app