Google

Google Webmaster Tools Adds Settings Section & Enhances Crawl Rate Controls

The Google Webmaster team announced three main things at their blog over the past day or so. The first we covered, was the new Google help discussions area. The second was adding a new settings link in webmaster tools to consolidate some features. The third item is enhancements to controlling your crawl rate.

Let me take you through the last two in more detail.

Google has moved four features to this new settings area. The features include setting your geographic target, controlling your preferred domain, opting in to enhanced image search and setting your crawl rate control. The crawl rate control will be discussed below, cause that feature was slightly changed. Here is a picture of the new settings page:

Google Webmaster Tools Settings

Google enhanced the crawl rate controls to let you either choose to let Google determine the best control rate or let advanced users pick their own crawl rates. Do note, like I said at the Search Engine Roundtable, some webmasters are reporting that they are unable to change their control rates. Here is a picture of the new AJAX slider you can use to change your crawl rate at a more granular level:

Google Crawl Rate

Explore more on

Ajax Google Google Search Console Search engine optimization Search Engine Roundtable Web scraping Webmaster
Add Search Engine Land as a preferred source on Google

Editorial disclosure

Search Engine Land is owned by Semrush. We remain committed to providing high-quality coverage of marketing topics. Unless otherwise noted, this page’s content was written by either an employee or a paid contractor of Semrush Inc.

About the author

Barry Schwartz
Barry Schwartz is a technologist and a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics.

In 2019, Barry was awarded the Outstanding Community Services Award from Search Engine Land, in 2018 he was awarded the US Search Awards the "US Search Personality Of The Year," you can learn more over here and in 2023 he was listed as a top 50 most influential PPCer by Marketing O'Clock.

Barry can be followed on X here and you can learn more about Barry Schwartz over here or on his personal site.