Search Illustrated

Search Illustrated: Google’s Organic Crawl


Google has two crawlers, each with a different function, to assure that it’s index of the web is both deep and up to date. Today’s Search Illustrated shows the function of each of these content discovery utilities:

google-organic-crawl.gif

Graphic by Elliance, an eMarketing firm specializing in results-driven search engine marketing, web site design, and outbound eMarketing campaigns. The firm is the creator of the ennect online marketing toolkit. The Search Illustrated column appears Tuesdays at Search Engine Land.

Opinions expressed in the article are those of the guest author and not necessarily Search Engine Land.


Elliance Graphic by Elliance, an eMarketing firm specializing in results-driven search engine marketing, web site design, and outbound eMarketing campaigns. The firm is the creator of the ennect online marketing toolkit. The Search Illustrated column appears Tuesdays at Search Engine Land.

See more articles by Elliance >


Search Illustrated uses graphics to illustrate complex topics in search marketing by breaking them down into easily understood pictures and diagrams. The Search Illustrated column appears weekly at Search Engine Land.To get this column via email or feed, visit our columns page.


Share, Bookmark & Discuss This Article
More:


Keep Updated: News Via Email | News Via RSS Feed | News Via Twitter


See more stories like this in the Members Library! Check out the Search Illustrated sections of the Members Library where this story is filed. Members also get access to exclusive video content, a members-only weekly & monthly newsletter, plus more. Check out all the benefits!

2 COMMENTS ON Search Illustrated: Google’s Organic Crawl

Tech Mentat,

Is it 2 bots each with 1 type of crawl or 1 bot with 2 different types of crawl? I ask b/c if it’s 2 bots then it would be possible to disallow the “fresh” bot to stagnant content and have it only focus on frequently updated pages/directories.



海外SEOアナリスト,

Very interesting article.
I wonder how we can get benefit from this technical info on SEO.

Do you have any idea?





RECENT COMMNENTS

  • nickstamoulis said " Hi Travis, Very good points, but also something to consider is the overall demographics that use the"
  • nickstamoulis said " Hi Nick, I agree with 1000%. Having worked at several agencies and on the client side and more recen"
  • nickstamoulis said " Thanks Matt for highlighting this functionality! I personally think the send to phone, email and GPS"

See All »


FREE DAILY SEARCH NEWS RECAP!

Stay on top of all the search news with our daily summary, the SearchCap newsletter. View a sample ›

STAY CURRENT THROUGHOUT THE DAY

RSS Feeds

The Search Engine Land feed keeps you informed as news happens. SEE ALL FEEDS »

Upcoming Search Engine Land Conferences

Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.


SMX Web Site » | SMX Difference » | SMX News »


Join us at an upcoming SMX event:

Search Marketing Now Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:


See more webcast topics »

TRACK US SOCIALLY
Upcoming Search Engine Land Conferences

Get Your Search Engine Land
Premium Membership!

Become a premium member today and receive:

  • Express commenting privileges & photo.
  • Exclusive videos & newsletters.
  • Discounts to our SMX conferences.
  • Access to "How To" & Other Archives.

Learn More

Upcoming Search Engine Land Conferences
Add to GoogleAdd to My Yahoo!Add to BloglinesAdd to NetvibesAdd to Windows Live