Google Enhances Webmaster Central’s Robots.txt Analysis Tool

Aug 16, 2007 at 8:58am ET by Barry Schwartz

The Google Webmaster Central Blog announced improvements they have made to the robots.txt analysis tool.

The tool now recognizes all sitemap declarations and relative URLs. So now the tool will report the validity of all sitemaps URLs plus show data for relative URLs. In addition, Google has expanded the reporting to include data for not just the first problem encountered, like they did in the past. Now they also show all problems encountered, on multiple lines and itemized by line number.

Barry Schwartz is Search Engine Land's News Editor and owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry's personal blog is named Cartoon Barry and he can be followed on Twitter here.

See more articles by Barry Schwartz >

Share, Bookmark & Discuss This Article
More:

Keep Updated: News Via Email | News Via RSS Feed | News Via Twitter

See more stories like this in the Members Library! Check out the Google: SEO, Google: Webmaster Central, SEO: Blocking Spiders sections of the Members Library where this story is filed. Members also get access to exclusive video content, a members-only weekly & monthly newsletter, plus more. Check out all the benefits!

ONE COMMENT ON Google Enhances Webmaster Central’s Robots.txt Analysis Tool

Sam I Am, August 17th, 2007 at 6:00 am ET:

That’s good news, although unfortunately they have not done anything about the clear contrasting information they are spreading either through their webmaster help area or the robots.txt tool. I’ve documented this quite well over at the google groups but no feedback so far. Quite frankly I’m surprised no one has noticed this before considering you can seriously mess up a sites ranking based on the information google is giving out in these two places (one which directly contradicts the other).

http://groups.google.com/group/Google_Webmaster_Help-Tools/browse_thread/thread/181ea5d12a78b721/2f2fb41d38de199f

TOP STORIES

See All »

SEARCH NEWS BRIEFS

See All »

FEATURES & ANALYSIS

See All »

RECENT COMMNENTS

Buy Advertising said " I've been experimenting with the merger of advertising and entertainment. I think that it can be bot"
nickstamoulis said " Wow, this is very interesting, I was not aware of the the Google Books case at all, I will be sure t"
nickstamoulis said " These are all very cool, my personal favorite 4th logo is the Ask.com layout, it is very creative!"

See All »

See How To Articles And More In Our Members Library »

FREE DAILY SEARCH NEWS RECAP!

Stay on top of all the search news with our daily summary, the SearchCap newsletter. View a sample ›

STAY CURRENT THROUGHOUT THE DAY

The Search Engine Land feed keeps you informed as news happens. SEE ALL FEEDS »

SEARCH ENGINE LAND SPONSORS

Advertise With Us »

UPCOMING SEARCH ENGINE LAND CONFERENCES

Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.

SMX Web Site » | SMX Difference » | SMX News »

Join us at an upcoming SMX event:

UPCOMING SEARCH ENGINE LAND WEBCASTS

Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include: