Report: Open Source The Index Says Google Exec

Blogger and former journalist Tom Foremski reports he had a conversation with the head of engineering for Google in Brazil and says the guy supported the idea of open-sourcing the search index:

I mentioned an idea I had about making the Google index into an open database that anyone could access, I said that this could dramatically speed up the Internet.

He said it was a good idea and that I “should write a position paper” on this subject.

Since this is hearsay (as opposed to heresy) we don’t know exactly what was said. But Foremski goes on to explain and argue that multiple search indexes and crawlers take up bandwidth and slow his site’s (and the internet’s ) performance and are generally inefficient.

Many people would presumably welcome the idea of a single open-source search index (this is a cousin of the argument about an open database of places.) And there have been various efforts to build such an open-source search index that can be used by multiple parties. Yahoo’s BOSS is a similar project in a narrower sense. However the idea that Foremski is pushing is that Google open-source its index or that all the majors collaborate on a single index.

It won’t come to pass any time soon in all likelihood. But if it were to happen what then would be the difference between Google and Yahoo or Microsoft or AOL? The difference would reside in the algorithm and UI. Somewhat ironically, this is the same pitch that Yahoo is making to the market in a post-Bing index world.

What Foremski is calling for would do little to address Google’s critic’s issues, however. Their issue is with Google’s control over the algorithm and how sites are ranked, and not about the search index per se.

See the related post: Google: As Open As It Wants To Be (i.e., When It’s Convenient)

Related Topics: Channel: Consumer | Google: Web Search


About The Author: is a Contributing Editor at Search Engine Land. He writes a personal blog Screenwerk, about SoLoMo issues and connecting the dots between online and offline. He also posts at Internet2Go, which is focused on the mobile Internet. Follow him @gsterling.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


Get all the top search stories emailed daily!  


Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.

Comments are closed.

Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide