Google has two crawlers, each with a different function, to assure that it’s index of the web is both deep and up to date. Today’s Search Illustrated shows the function of each of these content discovery utilities:

Graphic by Elliance, an eMarketing firm specializing in results-driven search engine marketing, web site design, and outbound eMarketing campaigns. The firm is the creator of the ennect online marketing toolkit. The Search Illustrated column appears Tuesdays at Search Engine Land.
Opinions expressed in the article are those of the guest author and not necessarily Search Engine Land.
Related Topics: Infographics | Search Illustrated








Is it 2 bots each with 1 type of crawl or 1 bot with 2 different types of crawl? I ask b/c if it’s 2 bots then it would be possible to disallow the “fresh” bot to stagnant content and have it only focus on frequently updated pages/directories.
Very interesting article.
I wonder how we can get benefit from this technical info on SEO.
Do you have any idea?