Dec 19, 2007 at 9:13pm ET by Vanessa Fox
Earlier today, we reported that over 4 million Google AdSense ads were being indexed by Microsoft Live Search. Tonight, the Microsoft Live Search Webmaster Center blog has posted that they’ve identified and fixed the issue and that search results should return to normal within the next few days.
What happened? Google AdWords URLs are blocked by Google’s robots.txt file with this command:
Disallow: /pagead/
The blog post explains that when Live Search finds links to pages that are blocked by robots.txt, they may index the link (as listed URL) and anchor text (as the listed title). Google and Yahoo do the same. Google calls these results “partially indexed URLs” and Yahoo! calls them “thin listings.” Live Search found these AdWords URLs as links in AdSense blocks on sites they crawled.
In this case, AdWords URLs were listed not only because of the way Live Search indexes blocked URLs, but also because of a change in how Google renders AdSense units. However, the blog post doesn’t describe this change and the Google AdSense blog doesn’t mention changes.
Microsoft recently posted about another issue with their crawler that caused them to download AdSense blocks, which may have skewed ads reporting. Likely this latest issue wouldn’t impact ad reporting, as the bot crawling the AdSense links identified itself as MSNbot.
Share, Bookmark & Discuss This Article
More:
Keep Updated: News Via Email | News Via RSS Feed | News Via Twitter
See more stories like this in the Members Library! Check out the Google: AdSense, Google: AdWords, Microsoft: Bing SEO sections of the Members Library where this story is filed. Members also get access to exclusive video content, a members-only weekly & monthly newsletter, plus more. Check out all the benefits!
TOP STORIES
SEARCH NEWS BRIEFS
FEATURES & ANALYSIS
RECENT COMMENTS
Stay on top of all the search news with our daily summary, the SearchCap newsletter. View a sample ›
Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.
SMX Web Site » | SMX Difference » | SMX News »
Join us at an upcoming SMX event:
Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:
Featured sites from our Blogroll
Become a premium member today and receive: