Will Allen
Vice President at Cloudflare involved in bot management and product strategy, emphasizing publisher control over content access and building programmatic pay-per-crawl tooling.
Best podcasts with Will Allen
Ranked by the Snipd community
8 snips
Oct 7, 2025 • 31min
It’s cat and mouse, but we will charge the AIs - Cloudflare
Will Allen, Vice President of Product at Cloudflare, discusses the company's initiative to protect publishers from AI crawlers misusing their content. He elaborates on the balance Cloudflare seeks to strike between enabling responsible AI access and safeguarding creators' rights. The podcast dives into enforcement tactics, with a focus on distinguishing between good and bad AI actors, and potential legal remedies for publishers. Allen also addresses innovative pricing models and emphasizes Cloudflare's commitment to customer empowerment and high-quality content amid the AI influx.
5 snips
Feb 19, 2026 • 20min
Why Stack Overflow and Cloudflare launched a pay-per-crawl model
Will Allen, Cloudflare VP who builds bot management and pay-per-crawl tooling. Josh Zhang, Stack Overflow SRE who runs bot traffic and DDoS defenses. Janice Manningham, Stack Overflow product leader on data licensing and access controls. They discuss why pay-per-crawl was needed, how crawlers and scraping evolved, technical 402 handling and tooling, and programmatic licensing vs enterprise deals.
