Google-InspectionTool – the new Google crawler for Google testing tools

Google has added a new Google crawler to its list, this one is uses for testing tools you use in Search Console or other Google properties.

Chat with SearchBot

Google has released a new crawler, a new Googlebot, named Google-InspectionTool. This new Google crawler will be how Google identifies crawling activity for the crawler used by Google Search’s testing tools, like the rich results test and Google Search Console’s URL inspection tool.

Google-InspectionTool. Google posted details about this new crawler in its help document over here. It says, “Google-InspectionTool is the crawler used by Search testing tools such as the Rich Result Test and URL inspection in Search Console. Apart from the user agent and user agent token, it mimics Googlebot.”

Here is a screenshot of that documentation:

Google Adds Google Inspectiontool To Crawlers 1684322082

User agent. The user agent token for its crawl activity can either be the classic Googlebot or the new Google-InspectionTool. Google also listed the full user agent strings which differ for mobile and desktop crawls:

  • Mobile
    Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Google-InspectionTool/1.0)
  • Desktop
    Mozilla/5.0 (compatible; Google-InspectionTool/1.0)

Why we care. If you are a crawler junky and you analyze the crawling activity and bot activity in your log files, you might see Google-InspectionTool show up. That is especially if you use the Rich Result Test and URL inspection in Google Search Console.

If you see issues with these tools doing their jobs, you might be blocking the Google-InspectionTool user agent from accessing your site. So make sure to allow Google-InspectionTool to crawl your site if you have strict rules in place.


About the author

Barry Schwartz
Staff
Barry Schwartz is a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry can be followed on Twitter here.

Get the must-read newsletter for search marketers.