Comments on: From The Isn’t It Ironic Dept: Google Product Search’s Results Show Up In Google

By: bizbuilder

bizbuilder — Mon, 09 Jul 2007 22:59:06 +0000

I just came across the original post, dated 4/30/07. I see some comments say the robots file has been updated to disallow the product searches, yet product searches are still showing up (as of today, 7/7/07). For example, do a Google search on: aluminum liner kit

By: jeremy mayes

jeremy mayes — Tue, 19 Jun 2007 20:04:19 +0000

SEL is allowing search results to be indexed?

http://www.google.com/search?num=100&hl=en&rlz=1T4GGIH_enUS216US216&q=site%3Asearchengineland.com+inurl%3Afastsearch%3F&btnG=Search

By: Matt Cutts

Matt Cutts — Tue, 01 May 2007 17:38:54 +0000

Even though Vanessa Fox did all of the heavy lifting to mention this to the right people, I can’t resist the punchline: Danny, this was an oversight, and the robots.txt file will be updated soon.

In fact, it already is. Thanks for noticing that in switching from Froogle to Product Search, the robots.txt didn’t add “/products?” to match the “/froogle?”.

By: Philipp Lenssen

Philipp Lenssen — Tue, 01 May 2007 09:37:55 +0000

They’ve adjusted their robots.txt now to block “/products?”. Those spammers ;)

By: NeO

NeO — Tue, 01 May 2007 02:27:01 +0000

That’s Hilarious Danny!!! I bet this makes it’s rounds in the blogosphere before those results are out of the main index.

Good find.