Auto-Research and LLMs Judging LLMs

The Amazon AI coding outage reignited a debate the industry can't ignore: is this an AI failure or a process failure, and does that distinction even matter anymore? Paige, Jack, Paul, and Noel dig into vibe coding culture, the engineer retention crisis, and the rise of harness engineering as a discipline in this month's panel. They also tackle autonomous agents running while you sleep, zero-touch engineering, what a senior engineer even means now, and whether open source can survive the agentic era.

Resources

Beyond the Hype: Why Vibe Coding Leaders Are Facing a Retention Crisis: https://www.forbes.com/councils/forbestechcouncil/2026/03/09/beyond-the-hype-why-vibe-coding-leaders-are-facing-a-retention-crisis/
Atlassian layoffs as part of AI push: https://www.theguardian.com/technology/2026/mar/12/atlassian-layoffs-software-technology-ai-push-mike-cannon-brookes-asx
I'm Building Agents That Run While I Sleep: https://www.claudecodecamp.com/p/i-m-building-agents-that-run-while-i-sleep

We want to hear from you!

How did you find us? Did you see us on Twitter? In a newsletter? Or maybe we were recommended by a friend?

Fill out our listener survey! https://t.co/oKVAEXipxu

Let us know by sending an email to our producer, Elizabeth, at elizabeth.becz@logrocket.com, or tweet at us at PodRocketPod.

Check out our newsletter! https://blog.logrocket.com/the-replay-newsletter/

Follow us. Get free stickers.

Follow us on Apple Podcasts, fill out this form, and we’ll send you free PodRocket stickers!

What does LogRocket do?

LogRocket provides AI-first session replay and analytics that surfaces the UX and technical issues impacting user experiences. Start understanding where your users are struggling by trying it for free at LogRocket.com. Try LogRocket for free today.

Chapters

00:00 Introduction & Panel Welcome
01:30 Amazon's AI Outage - Process Failure or AI Failure?
05:00 Harness Engineering and the Real Lesson from Stripe
08:30 The Retention Crisis - Are Good Engineers Leaving Tech?
11:30 The Satisfaction Problem - AI Stole the Mountain Climb
14:00 Code Review Is the New Bottleneck
16:00 Stripe vs Amazon - Two Different Philosophies on AI at Scale
18:00 Would You Restart Your Career in a World of Code Review?
21:00 Domain Experts as the New Engineers
24:00 Is Artisanal Code a Real Future?
28:30 Content in the AI Era - Who's It Even For?
30:30 Agents Running While You Sleep - The Verification Problem
33:00 Zero-Touch Engineering and How Paul's Team Does It
36:00 Auto-Research, LLMs Judging LLMs, and Brain Rot Scripts
40:00 Are We Actually Shipping Faster?
41:00 What Does "Senior Engineer" Mean Now?
47:00 Hot Takes - Open Source, USB-C, Defense Contracts, and Taste
53:00 Wrap-Up

Special Guest: Jack Herrington.