Live Search Testing New Crawler; MSNBot/2.0b

Dec 12, 2008 at 9:05am ET by Barry Schwartz

The Live Search Blog announced they are letting a new robot loose. The new search engine crawler is named msnbot/2.0b and will be added to the army of current MSN spiders, currently named msnbot/1.1.

The new spider is currently being tested but will ultimately replace the old spider. The new spider will respect the current robots.txt protocol set up for MSNBot, so no need to set up anything new in your robots.txt file. In addition, Microsoft promised to crawl slowly in their msnbot/2.0b tests.

MSNBot/1.1 is not that old. It was added back in February of this year and introduced HTTP compression and conditional gets.

Barry Schwartz is Search Engine Land's News Editor and owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry's personal blog is named Cartoon Barry and he can be followed on Twitter here.

See more articles by Barry Schwartz >

Share, Bookmark & Discuss This Article
More:

Keep Updated: News Via Email | News Via RSS Feed | News Via Twitter

See more stories like this in the Members Library! Check out the Microsoft: Bing, SEO: Blocking Spiders sections of the Members Library where this story is filed. Members also get access to exclusive video content, a members-only weekly & monthly newsletter, plus more. Check out all the benefits!

Comments are closed.

TOP STORIES

See All »

SEARCH NEWS BRIEFS

See All »

FEATURES & ANALYSIS

See All »

RECENT COMMENTS

pete142 said " Very good bartender analogy gives the main point of the article instant clarity. Well done! I am env"
webmarketingadvisor said " It would be interesting to know how the decisions about the logos are made - I've been keeping a blo"
solarian said " Your article would be more consistent if you provide some links to not optimized for search engines "

See All »

See How To Articles And More In Our Members Library »

FREE DAILY SEARCH NEWS RECAP!

Stay on top of all the search news with our daily summary, the SearchCap newsletter. View a sample ›

STAY CURRENT THROUGHOUT THE DAY

The Search Engine Land feed keeps you informed as news happens. SEE ALL FEEDS »

SEARCH ENGINE LAND SPONSORS

Advertise With Us »

UPCOMING SEARCH ENGINE LAND CONFERENCES

Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.

SMX Web Site » | SMX Difference » | SMX News »

Join us at an upcoming SMX event:

UPCOMING SEARCH ENGINE LAND WEBCASTS

Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include: