New SEO Tools: Robots.txt Builder, Term Targeting & Crawl Test
Apr 20, 2007 at 12:30pm ET by Barry Schwartz
Three new SEO tools came out this week that are worth a look. Dave Naylor released a robots.txt builder tool, while SEOmoz released term targeting and crawl test tools. Some more about the tools, below:
The Robots.txt Builder Tool David Naylor, the creator of the tool, explains that one of his clients accidentally blocked all robots to his site and found himself out of the search engines. So he decided to build this tool to make it easy for webmasters to make valid robots.txt files.
Term Targeting SEOmoz created this tool for their premium members and say they may open it up later to all users. The tool “analyzes the content of a given page and extracts the terms and phrases that appear to be targeted at search engines.”
Crawl Test Tool This tool from SEOmoz, previously only available to premium members, now is free for the public. They say the tool can “test how accessible your site is to search engines and can help you quickly diagnose potential crawling issues and give you an overview of your site’s search friendliness.”
Share, Bookmark & Discuss This Article
More:
Keep Updated: News Via Email | News Via RSS Feed | News Via Twitter
See more stories like this in the Members Library! Check out the SEM Tools sections of the Members Library where this story is filed. Members also get access to exclusive video content, a members-only weekly & monthly newsletter, plus more. Check out all the benefits!
4 COMMENTS ON New SEO Tools: Robots.txt Builder, Term Targeting & Crawl Test
TOP STORIES
SEARCH NEWS BRIEFS
FEATURES & ANALYSIS
RECENT COMMNENTS
- Buy Advertising said " I've been experimenting with the merger of advertising and entertainment. I think that it can be bot"
- nickstamoulis said " Wow, this is very interesting, I was not aware of the the Google Books case at all, I will be sure t"
- nickstamoulis said " These are all very cool, my personal favorite 4th logo is the Ask.com layout, it is very creative!"
FREE DAILY SEARCH NEWS RECAP!
Stay on top of all the search news with our daily summary, the SearchCap newsletter. View a sample ›
STAY CURRENT THROUGHOUT THE DAY
Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.
SMX Web Site » | SMX Difference » | SMX News »
Join us at an upcoming SMX event:
- SMX Singapore - July 2-3, 2009
- SMX São Paulo - August 4-5
- SMX East - October 5-7, 2009
- SMX Stockholm - 12-13 October, 2009
- SMX Mexico - November 11, 2009
Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:
- How Large Offline Marketers Drive Superior Search Marketing Results - July 21, 2009
- Trademarks, Brand Terms and PPC Advertising: Updates You Must Know - July
22, 2009
- Attribution Management Buyers Guide - July 28, 2009
TRACK US SOCIALLY
- Wall Street Journal Recommended Reading
- Ad Age Power 150 Blog
- Technorati Top 100 Blog
- Techmeme Leaderboard Source
- Best Search Engine Community/Forum
Featured sites from our Blogroll
Get Your Search Engine Land
Premium Membership!
Become a premium member today and receive:
- Express commenting privileges & photo.
- Exclusive videos & newsletters.
- Discounts to our SMX conferences.
- Access to "How To" & Other Archives.
© 2009 Third Door Media, Inc. All rights reserved. Google, Yahoo & Microsoft logos trademark respective companies and used with permission.
I usually read SEOMoz when I see something on this site that entices me to read more. This past week I tried the new services and signed up for premium services, however within an hour, I unsubscribed.
The crawl test software is flawed, it didn’t find our DMOZ listings on either Yahoo or Google, yet a quick manual search told me otherwise. I immediately decided the software wasn’t of value nor credible at all. If I’m going to pay for premium service, it would be preferable that the service actually worked, I should ask for my money back, but to be honest, I was so disappointed in the Premium service that I had no energy to fight for the $40.
The Term Targeting software was of no use either. Everything it told me, I already knew - this is why I optimize for these specific terms, and therefore the software should have found it.
What was useful, were links to software not within SEOMoz.
Asia:
This is Matt from SEOmoz, I created the Crawl Test tool along with the rest of SEOmoz’s tools.
First off: you are confusing the Crawl Test tool with the Page Strength tool (which is completely free, anyone can use it) The Crawl test does not fetch DMOZ results, it tests how accessible your site is by search engines and examines on-page factors.
Second, the term targeting tool examines a page and determines what terms appear to be important to search engines. If you ran it on your URL and it returned results you were already aware of, then bravo, your site is search optimized. However, try running it on a client or a competitor’s domain and see what kind of results you get. It’s incredibly useful for competitive research as well as catching problems on a site that hasn’t been well optimized.
Loving the robot builder tool from Dave!
Hey Matt (Oatmeal),
Keep up the great work with your tools, they are amazing!