Google Offers A Proposal To Make AJAX Crawlable


It’s one of the most common pieces of SEO advice you’ll find: Don’t build your web site with AJAX if you want it to be crawled and indexed by search engines. AJAX-based web sites are essentially a locked and bolted door when a spider comes crawling.

At our SMX East conference today, Google has announced a proposal to change that, a new standard that would make AJAX crawlable. If it comes to pass, and if the other major search engines go along with the idea, the proposal could serve as a green light for developers wanting to enjoy the rich features of using AJAX while not sacrificing search engine visibility.

The details of Google’s proposal are, to this non-developer, highly technical and more than I care to recap here. (Read Google’s blog post, linked above, for the details.) Google’s goals in creating the new standard are summed up in less technical language:

  • Minimal changes are required as the website grows
  • Users and search engines see the same content (no cloaking)
  • Search engines can send users directly to the AJAX URL (not to a static copy)
  • Site owners have a way of verifying that their AJAX website is rendered correctly and thus that the crawler has access to all the content

Google estimates that about 70% of all web content is created dynamically, and that figure is likely to grow. “This hurts search,” Google says. “Not solving AJAX crawlabilty holds back progress on the web.” Those quotes are from a Google Docs presentation deck about the proposal, embedded below.

Google is asking for feedback on the proposal in the Google Webmaster Central help forum.



Matt McGee is the Search Engine Land Assignment Editor, and offers search marketing consulting and training to businesses of all sizes. He blogs at Small Business Search Marketing and HyperlocalBlogger.com.

See more articles by Matt McGee >


Share, Bookmark & Discuss This Article
More:


Keep Updated: News Via Email | News Via RSS Feed | News Via Twitter


See more stories like this in the Members Library! Check out the Google: SEO, Google: Web Search, Top News sections of the Members Library where this story is filed. Members also get access to exclusive video content, a members-only weekly & monthly newsletter, plus more. Check out all the benefits!

4 COMMENTS ON Google Offers A Proposal To Make AJAX Crawlable

Duane Forrester,

Bound to happen. If the mountain won’t come to Mohammad, Mohammad will go to the mountain.

Good for them for putting this forward – truly a step in the right direction in terms of working with those who matter to you.



click2dennis,

This was a very interesting proposal. The audience seemed stunned at first because I don’t think there were lots of developers in the room. Although it may seem highly technical, It’s definitely worth exploring. I think that the audience did at least understand the need for the solution. I’m surpised by the use of yet another special character (the exclamation mark) but if developers will adopt, it will be good for search.



Robert,

Finally, Google gives in to AJAX. More and more sites nowadays relies on AJAX, because it is easily customizable and minor tweaks are needed when changing something within a site.

Let’s see what more changes are happening within Google.



Jowita Blak,

Great! I’m sure many web developers and SEOs will feel relieved. Currently the Web contain so much dynamic content and Ajax is a truly fantastic solution for serving it. AJAX improves user experience and its ability to pull data from the server after the page has loaded contrasts with the traditional website architecture. We should see more and more websites using AJAX and users won’t longer have to wait for the pages to reload to see new results from the server. Another barrier removed…look forward to further improvemnts in google’s crawling technology.




RECENT COMMENTS

  • Andy Atkins-Krüger said " Just to clarify what the non-English comments say, the Spanish is pretty much 'company B sucks', the"
  • allyaec said " Simple, clean and effective and the music is an excellent choice. I might be a nerd for liking it, b"
  • Carrie Hill said " SupidScript, First let me apologize for misleading or misdirecting you. I continually find it a stru"

See All »


FREE DAILY SEARCH NEWS RECAP!

Stay on top of all the search news with our daily summary, the SearchCap newsletter. View a sample ›

STAY CURRENT THROUGHOUT THE DAY

RSS Feeds

The Search Engine Land feed keeps you informed as news happens. SEE ALL FEEDS »

Upcoming Search Engine Land Conferences

Advertise With Us »

Search Marketing Expo

Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.


SMX Web Site » | SMX Difference » | SMX News »


Join us at an upcoming SMX event:

Search Marketing Now Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:


See more webcast topics »

TRACK US SOCIALLY
Upcoming Search Engine Land Conferences

Get Your Search Engine Land
Premium Membership!

Become a premium member today and receive:

  • Express commenting privileges & photo.
  • Exclusive videos & newsletters.
  • Discounts to our SMX conferences.
  • Access to "How To" & Other Archives.

Learn More

Upcoming Search Engine Land Conferences
Add to GoogleAdd to My Yahoo!Add to BloglinesAdd to NetvibesAdd to Windows Live