Topic: Googlebot

SearchCap: The Day In Search, December 28, 2009

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Bing Logo The Worst Identity of 2009, According To Brand New Under Consideration’s Brand New devision posted their best and worst identities of 2009. Guess who made the top of the […]

SearchCap: The Day In Search, December 18, 2009

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: How To Group Your Keywords; Plus: Q&A With WordStream’s Larry Kim Organizing your paid search keywords into the right ad groups can be a difficult task for even the best search […]

SearchCap: The Day In Search, December 10, 2009

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Search & Real Time Madness Make no mistake. I think real time search is indeed one of the most exciting developments that’s happened in the search space in years. But I […]

Google Adds Googlebot-News User Agent To Allow Blocking Google News

Google announced they have added a new supported user agent that can be used to block Google from indexing stories specifically on Google News. You can now specific the user agent Googlebot-News in your robots.txt file to exclude documents from being crawled and displayed in Google News. Google has several user agents for controlling how […]

Google Explains Importance Of Spam Free Web Sites

Google has written two spam related posts over the Thanksgiving period on the Google Webmaster Central Blog tackling the issue of comment spam. The first post focuses on the futility of comment spam, saying: At best, a link spammer might spend hours doing spammy linkdrops which would count for little or nothing because Google is […]

SearchCap: The Day In Search, November 20, 2009

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Search In Pictures: Google México Party, One Republic @ Google & Pineapple 5K In this week’s Search In Pictures, here are the latest images culled from the web, showing what people […]

SEO

SearchCap: The Day In Search, October 30, 2009

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Bing Adds NFL, Flight Information To Mobile Browser Bing has announced a couple additions to its mobile browser today: expanded NFL information and airline flight status reports. The NFL feature works […]

Google’s Additional Discovery Method: RSS and Atom Feeds

For years, Google’s discovery of web pages was solely based on links. If a page had no links to it, Googlebot had no way of knowing about it and therefore, would never index it. Along the way, Google provided an option for submitting individual pages, but that wasn’t really a viable option for site owners […]

SearchCap: The Day In Search, October 13, 2009

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: An Open Letter To Derek Powazek On The Value Of SEO Derek Powazek launched an attack on SEO yesterday that really said nothing that others haven’t ranted about before. I’ve responded […]

See What Googlebot Sees On Your Site

Google Webmaster Tools has just launched a “labs” section, where you’ll find new features that may be early in the development cycle and not quite as robust as the rest of the tools. The features available so far are Fetch as Googlebot, which lets you see exactly what Googlebot is served when it requests a […]

SEO

SearchCap: The Day In Search, September 9, 2009

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Google Says Domain Registrations Don’t Affect SEO, Or Do They? Over at Search Engine Roundtable today, Barry Schwartz writes about the latest comments from Google about domain registration and its impact […]

SEO

Google “Freshness” Factor May Mean Big Implications For Retailers

Changes that Google has made to search queries have a big potential implications for retailers and other merchants. Among the first to recognize this and make proactive site changes is Pinny Gniwisch, executive vice president of marketing at jewelry site www.ice.com. Ice.com is No. 166 in the Internet Retailer Top 500 Guide. Most search engines, […]

GoogleBot Art

A digital artist named Antonio Lizarazu Balué has created a piece he named GoogleBot. I spotted this via a Matt Cutts Twitter. Here is a low res of the art, but you can see them in better quality at this site.

Google Using OCR To Index Scanned Documents

It used to be that, if you hoped Google would index a PDF file, you had to create a PDF that was text-based, not image-based; Googlebot couldn’t recognize the content of scanned or image-based documents. According to an announcement today, that’s no longer the case. Google says it’s now using OCR (Optical Character Recognition) technology […]

Google’s First Click Free Program For Web Content, Not Just News

Google’s long had a “First Click Free” program that allows news publishers to make their content accessible to search spiders but requires human visitors to login if they’ve already viewed one page on the site for free — hence the “first click free” name. Earlier this year, Google said this program was OK for web […]

How Does Google Really Handle Flash Content?

Much was made earlier this year of Google’s announcement that they’ve improved the indexing of Flash content. For years, search marketers have warned against building sites in Flash because they weren’t able to be indexed by major search engines; an all-Flash site was a kiss of death where SEO is concerned. More than three months […]

SEO

Google Webmaster Tools Now Provide Source Data For Broken Links

Ever since Google Webmaster Tools started reporting on broken links to a site, webmasters have been asking for the sources of those links. Today, Google has delivered. From Webmaster Tools you can now see the page that each broken link is coming from. This information should be of great help for webmasters in ensuring the […]

SEO

Making Sense Of Google’s New Dynamic URL Recommendations

Google’s recent blog post recommending that webmasters avoid rewriting dynamic URLs caused a minor furor in the search marketing industry. Reactions ranged from nervous fears that sites with rewritten URLs should suddenly reverse out their extensive work, all the way to amazement and even anger that Google should recommend a halt to something that many […]

Live Search Webmaster Center Gains Crawl Error And Backlinks Reports

Today, the Microsoft Live Search Webmaster Center is launching its first major update since its initial debut last fall. The Live Search Webmaster Center is Microsoft’s hub for their communication with site owners, and the tools portion of that center now has new crawl issues reports, backlinks data, and download functionality. The Webmaster Center was […]

The Long Road To The Debate Over “White Hat Cloaking”

I really hate arguments over cloaking. Like really hate them. But Rand Fishkin recently did a chart outlining the degrees of "safeness" to cloaking that in turn riled up Google’s Matt Cutts in comments there. No doubt others at search engines also dislike the idea that any cloaking is "white hat." So I wanted to […]

Google Now Crawling And Indexing Flash Content

Historically, search engines have been unable to extract content, such as text and links, from Flash (SWF) files. Subsequently, much of the Flash-based content on the web has been unavailable in search results. This situation has been frustrating for web developers, who have tried to come up with workarounds to help get search engines to […]

Google Defines IP Delivery, Geolocation, & Cloaking

Maile Ohye at the Google Webmaster Central Blog has “defined” what Google considers to be IP delivery, geolocation, and cloaking. On the geolocation front, Google recommends you treat “Googlebot as you would a typical user from a similar location.” So, if Googlebot’s IP is coming from California, then serve up the same page you would […]

A Webmaster View Of Google’s Latest Search Quality

Since Google posted on how their search quality stuff works, I figured I take the webmaster view and tell you what webmasters and SEOs have been seeing from Google’s search quality as of late. As many of you know, my other search blog, the Search Engine Roundtable, covers webmaster and SEO related discussions from the […]