Search Off the Record

They unpack what it means for sites and pages to get “fat,” comparing raw bytes, transferred size, and perceived weight. They highlight huge growth in mobile page sizes and Googlebot’s per-URL fetch limits. They call out HTML bloat from inlined images and structured data. They discuss rendering costs, content parity between mobile and desktop, and practical ways to cut image and asset bloat.

A behind‑the‑scenes look at how Google’s crawling really works and why “Googlebot” is misleading. They explain the central crawling service that many Google products use. Topics include caching to avoid duplicate fetches, regional IP and geoblocking issues, throttling safeguards to prevent overwhelming sites, and byte limits and truncation policies for fetched content.

A deep dive into how browsers actually parse messy HTML and why that leniency exists. Tales of old cross‑browser hacks and why regexes fail on real pages. Concrete risks from misplaced meta and link tags that can break hreflang and canonical signals. Clearing up when preload, prefetch, and DNS prefetch help performance and indirectly affect search.

They debate whether websites still matter in 2026 and why the answer often depends on goals. They examine apps, voice assistants and chatbots as new ways to access web content. They explore risks of knowledge getting locked inside AI models. They weigh owning a site for control and monetization versus relying on social platforms for reach.

They break down the 2025 year-end crawl report and its biggest technical headaches. Faceted navigation and filter-driven URL bloat get close attention. Action parameters and plugins that spawn endless URL variants are explored. Irrelevant parameters, session IDs, calendar plugins, and encoding bugs round out the crawl chaos discussion.

Join Danny Warshavskyki, a guest contributor and SEO expert, as he dives into the evolving world of search. He discusses whether hiring an SEO professional is essential, emphasizing that great content should always come first. Danny critiques third-party SEO tools, urging users to be critical of their recommendations. He cautions against optimizing merely for domain scores or breaking content into smaller bites for Large Language Models, promoting a focus on what truly matters—serving audience needs and practical business goals.

Danny Sullivan, a search industry journalist and public liaison for Google, joins John Mueller for an insightful discussion on the evolution of SEO in the age of AI. They emphasize that AI isn't just a fad and stress the importance of focusing on high-quality, authentic content over trendy tactics. Danny explains how SEO encompasses new formats like AEO and GEO, urges creators to leverage multimodal approaches, and highlights the significance of structured data and meaningful conversions in this rapidly changing landscape.

Celebrate the 100th episode of Search Off the Record with Martin, Lizzi, Cherry, John and Gary as they revisit memorable moments, touching on a bunch of topics. This special episode touches on Google's mobile-first indexing, the intricacies of the Caffeine indexing system, and a deep dive into JavaScript scoping – and hoisting. You'll hear again about optimizing documentation traffic and the delightful world of Google Doodles. Discover key insights that impact your SEO strategies and web development practices. Resources: Episode transcript → https://goo.gle/sotr100-transcript Chapters: 0:00 - Welcome and 100th Episode Intro 2:21 - Lizzi's favorite: SEO starter guide readings 3:01 - Gary on Mobile-First Indexing Importance 3:39 - Revamping the SEO starter guide 5:13 - Meta tags and Google's indexing system 9:11 - Cherry's use of podcasts for work 12:09 - Deep dive into caffeine indexing 13:59 - The mechanics of data conversion in caffeine 16:12 - John's favorite: The magic of Google Doodles 23:30 - JavaScript ccoping and hoisting 25:47 - Optimizing documentation traffic 29:29 - Conclusion: 100 Episodes of Search Off the Record Listen to more Search Off the Record → https://goo.gle/sotr-yt Subscribe to Google Search Channel → https://goo.gle/SearchCentral Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team. #SOTRpodcast #SEO Speaker: Martin Splitt, John Mueller, Cherry Sireetorn Prommawin Products Mentioned: Search Console

Explore critical aspects of search engine optimization for web content that lives behind a login or paywall. In this episode, Martin and John cover how Googlebot interacts with these pages, the role of paywall structured data, and methods to prevent unintended indexing of private information. Get practical advice on improving your website's visibility and user experience while maintaining data security in Google Search. Resources: Episode transcript →https://goo.gle/sotr099-transcript Chapters: 0:00 - Intro 0:09 - Navigating SEO for login and paywalled content 2:01 - How Google indexes restricted content 10:51 - Strategies for controlling content visibility 20:54 - Testing and optimizing your site for Search Listen to more Search Off the Record → https://goo.gle/sotr-yt Subscribe to Google Search Channel → https://goo.gle/SearchCentral Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team. #SOTRpodcast #SEO Speaker: Martin Splitt, John Mueller Products Mentioned: Search Console

Explore the intriguing world of lazy loading and its impact on web performance! Discover how this technique optimizes resource loading and enhances user experience. Learn about the SEO implications, especially regarding indexing and Core Web Vitals like Largest Contentful Paint. Delve into the difference between native and custom implementations, and why not all images should be lazy-loaded. Plus, get insights into potential pitfalls and how to effectively utilize JavaScript for better results!