Topic: Googlebot

Matt Cutts Convinces Some South Korean Govt. Websites To Stop Blocking Googlebot

Matt Cutts, international diplomat? That might be the more appropriate title for Google’s chief spam cop. According to the Wall Street Journal, Cutts is in South Korea this week and, in a presentation Monday night for about 80 government officials, webmasters, lawyers and journalists, managed to singlehandedly convince some government reps to let Googlebot crawl […]

SearchCap: The Day In Search, January 30, 2012

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Yandex Joins Bing, Yahoo In Using Nokia-Navteq Map Data Russian search giant Yandex announced that it will be licensing data from Nokia-owned Navteq to offer better and more comprehensive maps coverage […]

SearchCap: The Day In Search, January 25, 2012

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Google Revamps Submit Content Page Google has updated their URL submission tool page and redesigned their Submit Your Content page. The old URL which was at google.com/webmasters/tools/submit-url/ now returns a page […]

SearchCap: The Day In Search, January 18, 2012

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Google’s 5th “Doodle 4 Google” Contest Opens For K-12 Students Google has launched its fifth annual “Doodle 4 Google” contest, and this year’s version appears to be bigger than ever and […]

Google Slows Web Crawlers To Help Blackouts Sites

As you know, there are many sites going black to protest SOPA and PIPA. Google has already offered blackout SEO advice but they decided to take it one step further by slowing down their spiders today. Pierre Far from Google posted on his Google+ that Google is slowing down GoogleBot’s crawl activity to reduce the […]

SEO

SearchCap: The Day In Search, December 16, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: The Stop Online Piracy Act (SOPA) Stalls In Congress The U.S. House Judiciary Committee abruptly adjourned today without voting on the Stop Online Privacy Act (SOPA), a controversial measure that would […]

SearchCap: The Day In Search, December 15, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Googlebot Identifies Smartphone Content With New User-Agent Google has announced that its mobile crawler now has a user-agent that’s specific to smartphones. The company has already had a user-agent that targets […]

Googlebot Identifies Smartphone Content With New User-Agent

Google has announced that its mobile crawler now has a user-agent that’s specific to smartphones. The company has already had a user-agent that targets feature phones. The new Smartphone Googlebot-Mobile user agent is: Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; Googlebot-Mobile/2.1; +https://www.google.com/bot.html) […]

SearchCap: The Day In Search, November 2, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Yahoo Product Runway: Livestand And IntoNow Yahoo held its second now annual “Product Runway” event, mc’d by product chief Blake Irving. Irving was assisted by some younger executives from companies that […]

Google’s Definitive Cloaking Video

Matt Cutts, head of Google’s Webspam team, posted a long video that he named the “definitive cloaking video.” Here is the video, I will post the main points below: Cloaking is showing different content to users than GoogleBot Cloaking Violation of Quality Guidelines Cloaking is High Risk It Is Often Used For Deceptive Reasons No […]

SearchCap: The Day In Search, November 1, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Google Can Now Execute AJAX & JavaScript For Indexing This morning we reported that the comments on Facebook are being indexed by Google. Google’s Matt Cutts just confirmed on Twitter that […]

Google Can Now Execute AJAX & JavaScript For Indexing

This morning we reported that the comments on Facebook are being indexed by Google. Google’s Matt Cutts just confirmed on Twitter that Google is now able to “execute AJAX/JS to index some dynamic comments.” This gives Google’s spider, GoogleBot, the ability to read comments in AJAX or JavaScript, such as Facebook comments or Disqus comments […]

SearchCap: The Day In Search, October 26, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Cats & Dogs Living Together: Bing Promotes Firefox If you ever wanted proof that Microsoft has learned that for Bing to succeed, it needs to spread its wings beyond Microsoft, look […]

SearchCap: The Day In Search, August 26, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Google Signals Upcoming Algorithm Change, Asks For Help With Scraper Sites Google is calling for help in identifying a long-running problem: scraper sites in its search results — and particularly scraper […]

Google Retires The Googlebot-News Bot

Today, Google announced that they will no longer be crawling news sites with Googlebot-News and instead will crawl news sites with Googlebot, the same bot that crawls sites for web search. However, you can still block your content from being indexed in Google News by disallowing Googlebot-News in robots.txt or using a meta robots tag. […]

Google Adds URL Parameter Options to Google Webmaster Tools

In 2009, Google launched the parameter handling feature of Google webmaster tools, which enabled site owners to specify the parameters on their site that were optional vs. required.  A year later, they improved this feature by providing an option for a default value. Google says that they’ve seen a positive impact from the usage of those […]

How Twitter’s Technical Infrastructure Issues Are Impacting Google Search Results

In the last few days, several noticed that the Google Toolbar PageRank value for www.twitter.com had plummeted to 0 (it’s now back to its previous 9). Was Google punishing Twitter for how things went down with the feed expiration that temporarily derailed Google’s Realtime search efforts? Nah, Twitter’s website has just been suffering from technical […]

SearchCap: The Day In Search, June 3, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Introducing: The Periodic Table Of SEO Ranking Factors SEO — search engine optimization — is one of the most important marketing activities available to companies and publishers, but it’s too often […]

SearchCap: The Day In Search, May 31, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Twitter Intros Instant Follow Button In a bid to increase its presence across the Web, Twitter today announced the “follow button,” a snippet of code that can be placed on any […]

SearchCap: The Day In Search, May 18, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: The Doctor Is In: Using An Unbranded Health Site Recently, I had an amazing experience. I was invited to be a part of an all agency partner meeting. Throughout the day, […]

Google Sending Additional Reconsideration Request Responses To Webmasters

Monday I reported at the Search Engine Roundtable that Google’s Webmaster Central team has begun stepping up webmaster communication, once again, this time by responding to reconsideration requests more actively then in the past. Google is now telling webmasters that submit reconsideration requests if  their penalty is not a manual Google penalty, then there is […]

Should You Ban A Country From Visiting Your Website?

Website owners often put a website online and let the entire world access its contents. Essentially, they are claiming to service the world. But how often is this really the case? We found that on average, 10% of our clients’ website traffic was coming from outside of their geographic target market. This average is from […]

SearchCap: The Day In Search, March 10, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: LinkedIn Lauches a Social News Site If Digg and its myriad imitators were part of “social news 1.0″ then a recent wave of personalized news sites, including Flipboard and Zite for […]

SearchCap: The Day In Search, March 9, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Building Empathy For Googlebot With one persona, copywriters and designers will gain a better understanding of Googlebot and do a better job of creating a site that will appeal to him. […]

SearchCap: The Day In Search, February 22, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Should Korean Search Engine Naver Worry About Local Competitors Or Google? For just about the last decade, Naver has been the dominant player in the south Korean search market holding a […]

Google On Designing Mobile Friendly Websites

Pierre Far from Google wrote a blog post on how to design mobile friendly websites while considering Google’s webmaster guidelines and best practices. I’ve pulled out the key points from this post in bullet format: Google differentiates between traditional mobile phones and smartphones. Google has two bots: Googlebot and Googlebot-Mobile. Googlebot crawls desktop-browser type of […]

SearchCap: The Day In Search, February 7, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Instant Replay: Where To Find The Super Bowl Ads Are you one of those people who get upset when the Super Bowl gets interrupted by football or corny half-time events? You […]

SearchCap: The Day In Search, January 13, 2011

Below is what happened in search today, as reported on Search Engine Land and from other places across the web. From Search Engine Land: Google’s New China Plan: Target Display Advertisers, Report Says Despite its ongoing struggles in China, Google reportedly has a new plan for its business there: targeting display advertising, particularly amongst the […]

Google Vows Renewed Look At Cloaking In 2011

The head of Google spam fighting team, Matt Cutts, has tweeted that Google will be looking more at cloaking in the first quarter of 2011, perhaps with more clarification of what exactly cloaking is. Cloaking, which is against Google’s webmaster guidelines, is defined by Google as follows: Cloaking refers to the practice of presenting different […]

SEO

Writing HTML Title Tags For Humans, Google & Bing

I generally enjoy John Gruber’s writings, but today he’s dishing out SEO advice about HTML title tags. Some of it is bad advice. So with respect, here’s how I’d suggest you write page titles in a way that can please search engines and humans alike. What Is An HTML Title Tag? Let me go back […]