• Search Engine Land
  • Sections
    • SEO
    • SEM
    • Local
    • Retail
    • Google
    • Bing
    • Social
    • Resources
    • More
    • Home
  • Follow Us
    • Follow
  • Search Engine Land
  • SEO
  • SEM
  • Local
  • Retail
  • Google
  • Bing
  • Social
  • Resources
  • Live
  • More
  • Events
    • Follow
  • SUBSCRIBE

Search Engine Land

Search Engine Land
  • SEO
  • SEM
  • Local
  • Retail
  • Google
  • Bing
  • Social
  • Resources
  • More
  • Newsletters
  • Home
SEO

Google launches new crawl stats report in Search Console

Google has revamped the crawl stats report to provide actionable and useful data to your crawling issues.

Barry Schwartz on November 24, 2020 at 11:13 am
  • More

Google has announced the launch of a new crawl stats report in Google Search Console.

You may be able to access this report over here but keep in mind Google is rolling this out now and it might generate an error for you.

What’s new. Google said the new report makes it easier for developers, webmasters, SEOs, etc to find issues with Google crawling. What is new is:

  1. Total number of requests grouped by response code, crawled file type, crawl purpose, and Googlebot type.
  2. Detailed information on host status
  3. URL examples to show where in your site requests occurred
  4. Comprehensive summary for properties with multiple hosts and support for domain properties

New crawl stats report. This new chart shows your crawl stats over time, showing you the total crawl requests over a time period or by day, total downloaded data and the average response time.

Google also has a way to break it down into “grouped crawl data.” The report provides data on crawl requests broken down by these groups: (1) response, (2) file type of the fetched URL, (3) purpose of the crawl request, (4) and Googlebot agent.

Hosting issues are also uncovered with this report. So Google can show you why it had issues accessing your site. Google said “host status details in the report let you check your site’s general availability to Google in the last 90 days.” And for domain properties with multiple hosts, you can check the host status for each of the top hosts presented in the report summary view.

Why we care. Google has supported the legacy crawl stats report for years and with the new Google Search Console here, Google has not yet migrated this feature. Not only has it really improved on the reports, it has given us actionable and useful data to use when debugging crawling issues. To learn more about this report, see this help document.



About The Author

Barry Schwartz
Barry Schwartz a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry's personal blog is named Cartoon Barry and he can be followed on Twitter here.

Related Topics

Channel: SEOGoogle: Search ConsoleGoogle: SEOSEO: Crawling and Robots

We're listening.

Have something to say about this article? Share it with us on Facebook, Twitter or our LinkedIn Group.

Get the daily newsletter search marketers rely on.
See terms.

ATTEND OUR EVENTS

Lorem ipsum doler this is promo text about SMX events.

February 23, 2021: SMX Report

April 13, 2021: SMX Create

May 18-19, 2021: SMX London

June 8-9, 2021: SMX Paris

June 15-16, 2021: SMX Advanced

August 17, 2021: SMX Convert

November 9-10, 2021: SMX Next

October 2021: SMX Advanced Europe

December 17, 2021: SMX Code

Available On-Demand: SMX

×


Learn More About Our SMX Events

Discover actionable tactics that can help you overcome crucial marketing challenges. Our next conference will be held:

MarTech 2021: March 16-17

MarTech 2021: Sept. 14-15

MarTech 2020: Watch On-Demand

×

Attend MarTech - Click Here


Learn More About Our MarTech Events

White Papers

  • Data SEO – The Next Big Adventure
  • Getting Started with Email Marketing Automation
  • The State of Local Marketing Report 2020-2021
  • Quality CRM Data: The Key to Delivering Great Customer Experiences
  • How the Microsoft Search Network Can Maximize Your Search Campaigns
See More Whitepapers

Webinars

  • How to Avoid the Digital Transformation Trap
  • How to Build a Marketing System of Record
  • Meet BIMI: The brand-boosting email security marketers must have for 2021
See More Webinars

Research Reports

  • Local Marketing Solutions for Multi-Location Businesses
  • Enterprise Digital Asset Management Platforms
  • Identity Resolution Platforms
  • Customer Data Platforms
  • B2B Marketing Automation Platforms
  • Call Analytics Platforms
See More Research

h
Receive daily search news and analysis.
Search Engine Land
Download the Search Engine Land App on iTunes Download the Search Engine Land App on Google Play

Channels

  • SEO
  • SEM
  • Local
  • Retail
  • Google
  • Bing
  • Social

Our Events

  • SMX
  • MarTech

Resources

  • White Papers
  • Research
  • Webinars
  • Search Marketing Expo
  • MarTech Conference

About

  • About Us
  • Contact
  • Privacy
  • Marketing Opportunities
  • Staff
  • Connect With Us

Follow Us

  • Facebook
  • Twitter
  • LinkedIn
  • Newsletters
  • Instagram
  • RSS
  • Youtube
  • iOS App
  • Google Play

© 2021 Third Door Media, Inc. All rights reserved.

Your privacy means the world to us. We share your personal information only when you give us explicit permission to do so, and confirm we have your permission each time. Learn more by viewing our privacy policy.Ok