Yahoo Slurp Gets More Efficient & New Index Update

The Yahoo Search Blog announced that they have made major changes to their crawling process, plus rolled out a new update to their crawling, indexing and ranking systems. Recently, there have been many complaints that Yahoo’s crawler, Yahoo Slurp, is crawling sites too heavily. Yahoo says it has taken this feedback and has improved their […]

Chat with SearchBot

The Yahoo Search Blog announced that they have made major changes to their crawling process, plus rolled out a new update to their crawling, indexing and ranking systems.

Recently, there have been many complaints that Yahoo’s crawler, Yahoo Slurp, is crawling sites too heavily. Yahoo says it has taken this feedback and has improved their crawl process to have less of an impact on servers. You should notice a reduction in crawl load from Slurp, the company says.


About the author

Barry Schwartz
Staff
Barry Schwartz is a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry can be followed on Twitter here.

Get the must-read newsletter for search marketers.