Subscribe Via Web Feed Subscribe with Google Add to My Yahoo! Subscribe with Bloglines Add to netvibes Subscribe with Live.com

« Google Declares Stephen Colbert As Greatest Living American | Main | Search In Pictures: Easter; Search Fun, Google Power, Art & Signs »

Apr. 20, 2007 at 12:30pm Eastern by Barry Schwartz

New SEO Tools: Robots.txt Builder, Term Targeting & Crawl Test

Three new SEO tools came out this week that are worth a look. Dave Naylor released a robots.txt builder tool, while SEOmoz released term targeting and crawl test tools. Some more about the tools, below:

The Robots.txt Builder Tool
David Naylor, the creator of the tool, explains that one of his clients accidentally blocked all robots to his site and found himself out of the search engines. So he decided to build this tool to make it easy for webmasters to make valid robots.txt files.

Term Targeting
SEOmoz created this tool for their premium members and say they may open it up later to all users. The tool "analyzes the content of a given page and extracts the terms and phrases that appear to be targeted at search engines."

Crawl Test Tool
This tool from SEOmoz, previously only available to premium members, now is free for the public. They say the tool can "test how accessible your site is to search engines and can help you quickly diagnose potential crawling issues and give you an overview of your site's search friendliness."

Like The Story? Vote For It On Yahoo Buzz!
Subscribe To Our Daily Search News Recap!
Your Email:
Send me the monthly search newsletter too! (Learn more about our newsletters and feeds)
Subscribe To Our Search Feed!
Subscribe Via Web FeedSubscribe with GoogleAdd to My Yahoo!Subscribe with BloglinesAdd to netvibes
Subscribe with Live.comSubscribe in NewsGator OnlineSubscribe in RojoAdd to My AOL
Share & Bookmark This Story!
By Barry Schwartz Permalink Jump To Comments See Related Stories In: SEM Tools



Reader Comments

I usually read SEOMoz when I see something on this site that entices me to read more. This past week I tried the new services and signed up for premium services, however within an hour, I unsubscribed.

The crawl test software is flawed, it didn't find our DMOZ listings on either Yahoo or Google, yet a quick manual search told me otherwise. I immediately decided the software wasn't of value nor credible at all. If I'm going to pay for premium service, it would be preferable that the service actually worked, I should ask for my money back, but to be honest, I was so disappointed in the Premium service that I had no energy to fight for the $40.

The Term Targeting software was of no use either. Everything it told me, I already knew - this is why I optimize for these specific terms, and therefore the software should have found it.

What was useful, were links to software not within SEOMoz.

Asia:
This is Matt from SEOmoz, I created the Crawl Test tool along with the rest of SEOmoz's tools.

First off: you are confusing the Crawl Test tool with the Page Strength tool (which is completely free, anyone can use it) The Crawl test does not fetch DMOZ results, it tests how accessible your site is by search engines and examines on-page factors.

Second, the term targeting tool examines a page and determines what terms appear to be important to search engines. If you ran it on your URL and it returned results you were already aware of, then bravo, your site is search optimized. However, try running it on a client or a competitor's domain and see what kind of results you get. It's incredibly useful for competitive research as well as catching problems on a site that hasn't been well optimized.

Loving the robot builder tool from Dave!

Comment by Rhea [TypeKey Profile Page] | April 20, 2007 3:24 PM

Hey Matt (Oatmeal),

Keep up the great work with your tools, they are amazing!

Search:

Search Marketing Expo

Save the date for:
SMX China (Nanjing) - Sept. 23-24
SMX Stockholm - Sept. 23-24: See who's speaking or register now.
SMX East (New York City) - Oct. 6-8: See the agenda or register today and save!
SMX London - Nov. 4-5: Pre-agenda rate now available. Click here.

Search Marketing Now

Learn more about search marketing through free online webcasts and webinars from our sister site Search Marketing Now.

Upcoming Webcasts:

Most Recent News Posts

About Search Engine Land

Stay Updated!

Get Our Search Newsletters:
Email:
Daily Monthly

Get Our Search Feed:
Subscribe Via Web FeedSubscribe with Google
Add to My Yahoo!Subscribe with Bloglines
Add to netvibesSubscribe with Live.com
Subscribe in NewsGator OnlineSubscribe in Rojo
Add to My AOL
More About Our Feeds & Newsletters

Add to Technorati Favorites

Track Us Socially:
Facebook: Our Search News App
Facebook: Search Engine Land Page
Facebook: Search Engine Land Group
Flickr: Search Engine Land
LinkedIn: Search Engine Land Group
Twitter: Search Engine Land Feed

Bragroll