Google Webmaster Tools Updates Robots.txt Testing Tool

Google announced they have updated their robots.txt testing tool in Webmaster Tools. The update brings you a few more features including: (1) Highlights which line in your robots.txt file is blocking a specific page. (2) Make test changes to the robots.txt tool and test it before you make the file live. (3) Google will also […]

Chat with SearchBot

Google announced they have updated their robots.txt testing tool in Webmaster Tools. The update brings you a few more features including:

(1) Highlights which line in your robots.txt file is blocking a specific page.

(2) Make test changes to the robots.txt tool and test it before you make the file live.

(3) Google will also show you older versions of your robots.txt file to see past issues.

Here is a screen shot showing off the highlighting feature:

google-robotsttxt-teseter


About the author

Barry Schwartz
Staff
Barry Schwartz is a technologist and a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics.

In 2019, Barry was awarded the Outstanding Community Services Award from Search Engine Land, in 2018 he was awarded the US Search Awards the "US Search Personality Of The Year," you can learn more over here and in 2023 he was listed as a top 50 most influential PPCer by Marketing O'Clock.

Barry can be followed on X here and you can learn more about Barry Schwartz over here or on his personal site.

Get the newsletter search marketers rely on.