Technical SEO post-migration: How to find and fix hidden errors
Migrations can break your site in ways you never expected. Address SEO issues before they cost you rankings, traffic, and conversions.
Topic: Googlebot
AI optimization: How to optimize your content for AI search and agents
To be visible, optimize your site with clean HTML, metadata, fast responses, and bot-friendly configurations.
How to fix the ‘Page with redirect’ error in Google Search Console
Have you discovered the “Page with redirect” error in GSC? Learn to spot and fix it by improving content quality, site architecture, and more.
SEO noise vs. SEO signals: Distilling what truly impacts rankings
Google updates and industry buzz can cloud SEO strategy. Learn to separate the distractions from the essentials.
Top 5 takeaways from the 2024 Web Almanac SEO Chapter
Discover key learnings from a deep dive into web – including robots.txt files, robots directives, canonical use, dynamic rendering, and more.
Google clarifies how Google’s crawlers handle cache control headers
Google is also asking site owners to allow Google to cache your web pages.
Your guide to sitemaps: best practices for crawling and indexing
Sitemaps make it easier for search engines to discover and index your pages. Here's all you need to know and how to create one.
Server access logs and SEO: Everything you need to know in 2025
Here’s how analyzing server access logs can help you gain insights into bot activity, crawl efficiency and more for advanced SEO.
Google’s srsltid= parameter: What it means for SEO and attribution
Is Google misattributing organic search traffic to Shopping? Learn why the new srsltid= parameter in organic listings has stirred controversy.
How to deal with SEO emergencies
From rankings drops to site issues, learn which SEO problems require urgent action and how to prioritize your efforts effectively.
The ultimate guide to HTTP headers for SEO
Learn what HTTP headers are, how they influence website performance and security and best practices for optimization.
What is edge SEO?
Streamline SEO updates by implementing changes at the network's edge, improving website speed and flexibility.
Decoding Googlebot crawl stats data in Google Search Console
Dive into the lesser-known Crawl Stats reports, plus how to monitor Googlebot activity and identify actionable insights for enterprise sites.
Is Google using Chrome for mobile-first indexing and user signals?
SEO expert Cindy Krum explains how she believes Google is using Chrome user data for rendering, indexing, ranking and beyond.
Google updates crawlers and user-triggered fetchers documentation
With that, Google expanded how Google products are affected by each crawler and gave robots.txt examples for each crawler.
Was Google’s document ‘leak’ a strategic move? An SEO theory
What if the Google document "leak" was intentional? Here’s why it might have been purposefully shared with industry experts.
How Google Search ranking works
An in-depth analysis of how Google's complex ranking system works and components like Twiddlers and NavBoost that influence search results.
12 SEO metrics to add to your digital PR measurement program
Uncover insights to better understand your audience, optimize content and quantify PR impact by adopting these essential SEO metrics.
Google won’t index sites that do not work on mobile devices after July 5
if your website is not accessible using a mobile device, then Google will no longer index it and rank it.
How SEO moves forward with the Google Content Warehouse API leak
Addressing common questions, critiques and concerns following the massive Google Search leak and how your approach to SEO should change.
Google adds two new Googlebot crawlers: GoogleOther-Image and GoogleOther-Video
Google said these new crawlers are to "better support crawling of binary data that may be used for research and development."
How to avoid an SEO disaster during a website redesign
Avoid the costly mistake of losing all your SEO progress after a website overhaul. Here's how to protect your SEO assets during a redesign.
Climate change SEO survey: Making the web more sustainable
Uncover the link between SEO and environmental sustainability and how SEOs can aid in shaping a greener digital landscape.
A technical guide to video SEO
Discover advanced SEO techniques for video content, including self-hosting versus YouTube embedding and fool-proof indexing checks.
Does HTML structure matter for SEO?
HTML structure matters for SEO, but not in the ways most might think. Read on to uncover the real role of HTML for SEO.
Transform enterprise SEO challenges into opportunities
Juggling multiple large-scale SEO projects comes with its fair share of challenges. Learn how you can turn them into growth opportunities.
Googlebot crawl rate tool is now gone
You can no longer set your desired crawl rate within Google Search Console.
6 things that happen when Googlebot can’t crawl your website
An experiment by technical SEO expert Kristina Azarenko reveals what happens you disable Googlebot from crawling a website using robots.txt.
Number of websites blocking Google-Extended jump 180%
The New York Times, Yelp and 22 Condé Nast properties are among those who have chosen to block Google-Extended so far.
Googlebot crawl rate tool in Search Console is going away
The tool is going away on January 8, 2024 because Google says it is no longer useful.
Google says mobile-first indexing is complete after almost 7 years
Google said it will turn off the indexing crawler information in the settings page in Search Console.
Report: Generative AI violates copyright law, rights of news publishers
News publishers are concerned that AI answers will replace Search traffic, leading to less revenue, lost jobs and other damages.
Google updates Favicon search documentation
Google removed the Favicon user agent and said you must allow Googlebot and Googlebot-Image for Google to index your site's favicon.
Google-Extended does not stop Google Search Generative Experience from using your site’s content
Instead, you need to block SGE by blocking Googlebot completely.
An SEO guide to optimizing your Google Publisher Center account
Boost your brand’s visibility on Google News platforms with this advanced guide for Publisher Center optimization.
Using ChatGPT to drive technical SEO
Learn how ChatGPT help streamline your technical SEO efforts, including with schema, meta descriptions, .htaccess rewrite rules and more.
Mitigating technical SEO issues by empowering engineers
Engineers are at the forefront of web development. Here's how their understanding of technical SEO can be transformative for an enterprise.
GPTBot: OpenAI releases new web crawler
You can now prevent OpenAI's ChatGPT from accessing your website, or parts of it, using robots.txt.
Robots.txt is not the answer: Proposing a new meta tag for LLM/AI
Using robots.txt for managing data usage in LLMs is the wrong approach in this new age of generative AI products. Here's why.
Crawlers, search engines and the sleaze of generative AI companies
AI companies see the openness of the web as permitting large-scale crawling to obtain training data. So what should publishers do?