Mar 19, 2012 at 9:30am ET by Adam Audette

Technical SEO topics such as pagination are near and dear to my heart. This article will build upon and update my previous treatment of pagination and SEO. I've written and presented often on pagination for SEO. Why so much attention on this subject? The reason is simple: it can be a big, hairy deal for sites. It's right up there with faceted navigation as one of the most problematic crawling and indexing issues for large-scale SEO. It's a tactic (actually a set of tactics) that our teams are continually evolving, testing, and refining. So it was "double prizes" when Google announced [...]

Google Slows Web Crawlers To Help Blackouts Sites

Jan 18, 2012 at 9:10am ET by Barry Schwartz

As you know, there are many sites going black to protest SOPA and PIPA. Google has already offered blackout SEO advice but they decided to take it one step further by slowing down their spiders today. Pierre Far from Google posted on his Google+ that Google is slowing down GoogleBot's crawl activity to reduce the effect on their site's search rankings, if they did not follow the Google SEO advice from yesterday. Pierre Far said: Hello webmasters! We realize many webmasters are concerned about the medium-term effects of today's blackout. As a precaution, the crawl team at Google has conf [...]

Related Topics: Google: SEO | SEO: Blocking Spiders

How To Blackout Your Site (For SOPA/PIPA) Without Hurting SEO

Jan 16, 2012 at 2:39pm ET by Matt McGee

A number of websites are (or were) planning to "go black" this week while the U.S. Congress discusses issues related to the Stop Online Piracy Act (SOPA) and the Protect IP Act (PIPA). The website blackouts are part of a larger social media effort against the bills that our Greg Finn wrote about this morning on Marketing Land. You may be thinking about joining the website blackout movement, but yikes ... what about the SEO implications? How do you take your site offline in protest without messing up your visibility in Google's search results? Well, Google's Pierre Far shared several tips [...]

Google Can Now Execute AJAX & JavaScript For Indexing

Nov 1, 2011 at 1:57pm ET by Barry Schwartz

This morning we reported that the comments on Facebook are being indexed by Google. Google's Matt Cutts just confirmed on Twitter that Google is now able to "execute AJAX/JS to index some dynamic comments." This gives Google's spider, GoogleBot, the ability to read comments in AJAX or JavaScript, such as Facebook comments or Disqus comments and others that are dynamically loaded via AJAX or JavaScript. In addition, this means, Google is better at seeing the content behind more of your JavaScript or AJAX. Postscript: Google now has an official blog post up with more details. Related [...]

Related Topics: Google: SEO | SEO: Blocking Spiders | SEO: Flash | Top News

Google Disables URL Removals After Bug Allows Anyone To Remove Any Site

Jul 19, 2011 at 3:10pm ET by Barry Schwartz

This morning, James Breckenridge discovered a loophole within Google's Webmaster Tools that allowed anyone to remove any site from Google. Both James and I sent this information to Google as soon as we heard of it. After several hours, Google has told us, "we're still investigating this report, and to be cautious we disabled all URL removals earlier this morning." So now, if you even own a site, you won't be able to remove the site or pages from the site using Google's URL removal tool. How did this loophole work? Pretty simple as James described. You use the following URL when logged [...]

Become a PRO member and see all articles in our SEO: Blocking Spiders archives!

PRO Members get unrestricted access to all archives - and more!

Get Our News, Everywhere!

Follow @sengineland

Got a tip? Tell us here!

Most Likes
Most Tweets
Comments

Our Stories Being Liked on Facebook

Search Engine Land Sponsors

Advertise With Us

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!

Click to watch SMX conference video

Join us at an upcoming SMX event:

North America

SMX Advanced - June 5-6, 2012
SMX East - Oct. 2-4, 2012
SMX Social Media Marketing - Dec. 5-6, 2012
SMX Toronto - April 2013

EMEA

SMX Paris - June 7-8 2012
SMX Stockholm - Oct. 15-16, 2012
SMX Munich - Apr. 9-10, 2013
SMX London - May 2013

APAC

SMX Melbourne - Sept. 5-6, 2012
SMX Sydney - May 2013

Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.