Google Offers A Proposal To Make AJAX Crawlable


It’s one of the most common pieces of SEO advice you’ll find: Don’t build your web site with AJAX if you want it to be crawled and indexed by search engines. AJAX-based web sites are essentially a locked and bolted door when a spider comes crawling.

At our SMX East conference today, Google has announced a proposal to change that, a new standard that would make AJAX crawlable. If it comes to pass, and if the other major search engines go along with the idea, the proposal could serve as a green light for developers wanting to enjoy the rich features of using AJAX while not sacrificing search engine visibility.

The details of Google’s proposal are, to this non-developer, highly technical and more than I care to recap here. (Read Google’s blog post, linked above, for the details.) Google’s goals in creating the new standard are summed up in less technical language:

  • Minimal changes are required as the website grows
  • Users and search engines see the same content (no cloaking)
  • Search engines can send users directly to the AJAX URL (not to a static copy)
  • Site owners have a way of verifying that their AJAX website is rendered correctly and thus that the crawler has access to all the content

Google estimates that about 70% of all web content is created dynamically, and that figure is likely to grow. “This hurts search,” Google says. “Not solving AJAX crawlabilty holds back progress on the web.” Those quotes are from a Google Docs presentation deck about the proposal, embedded below.

Google is asking for feedback on the proposal in the Google Webmaster Central help forum.



Matt McGee is the Search Engine Land Assignment Editor, and offers search marketing consulting and training to businesses of all sizes. He blogs at Small Business Search Marketing and HyperlocalBlogger.com.

See more articles by Matt McGee >


Share, Bookmark & Discuss This Article
More:


Keep Updated: News Via Email | News Via RSS Feed | News Via Twitter


See more stories like this in the Members Library! Check out the Google: SEO, Google: Web Search, Top News sections of the Members Library where this story is filed. Members also get access to exclusive video content, a members-only weekly & monthly newsletter, plus more. Check out all the benefits!

4 COMMENTS ON Google Offers A Proposal To Make AJAX Crawlable

Duane Forrester,

Bound to happen. If the mountain won’t come to Mohammad, Mohammad will go to the mountain.

Good for them for putting this forward – truly a step in the right direction in terms of working with those who matter to you.



click2dennis,

This was a very interesting proposal. The audience seemed stunned at first because I don’t think there were lots of developers in the room. Although it may seem highly technical, It’s definitely worth exploring. I think that the audience did at least understand the need for the solution. I’m surpised by the use of yet another special character (the exclamation mark) but if developers will adopt, it will be good for search.



Robert,

Finally, Google gives in to AJAX. More and more sites nowadays relies on AJAX, because it is easily customizable and minor tweaks are needed when changing something within a site.

Let’s see what more changes are happening within Google.



Jowita Blak,

Great! I’m sure many web developers and SEOs will feel relieved. Currently the Web contain so much dynamic content and Ajax is a truly fantastic solution for serving it. AJAX improves user experience and its ability to pull data from the server after the page has loaded contrasts with the traditional website architecture. We should see more and more websites using AJAX and users won’t longer have to wait for the pages to reload to see new results from the server. Another barrier removed…look forward to further improvemnts in google’s crawling technology.



POST A COMMENT

Got a comment? Log in, register to comment or become a premium member to comment without CAPTCHA hassles, to have your own custom picture/avatar appear, plus many other benefits.


RECENT COMMENTS

  • Michael Martinez said " According to news sources, AOL's deal with Google runs out on December 17 and they have asked for (a"
  • EkOz said " IMO the pitfall in how Youtube handles ratings is that they only desplay an average rating. With no "
  • Robert said " There are smart phones that have RSS feed option in them. So even if your site is not mobile friendl"

See All »


FREE DAILY SEARCH NEWS RECAP!

Stay on top of all the search news with our daily summary, the SearchCap newsletter. View a sample ›

STAY CURRENT THROUGHOUT THE DAY

RSS Feeds

The Search Engine Land feed keeps you informed as news happens. SEE ALL FEEDS »

Upcoming Search Engine Land Conferences

Advertise With Us »

Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.


SMX Web Site » | SMX Difference » | SMX News »


Join us at an upcoming SMX event:

Search Marketing Now Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:


See more webcast topics »

TRACK US SOCIALLY
Upcoming Search Engine Land Conferences

Get Your Search Engine Land
Premium Membership!

Become a premium member today and receive:

  • Express commenting privileges & photo.
  • Exclusive videos & newsletters.
  • Discounts to our SMX conferences.
  • Access to "How To" & Other Archives.

Learn More

Upcoming Search Engine Land Conferences
Add to GoogleAdd to My Yahoo!Add to BloglinesAdd to NetvibesAdd to Windows Live