Is MIA In Bing, But It’s Not Censorship

The home page of, the well-known Microsoft Office competitor, is missing from Microsoft’s Bing search engine. While it sounds suspicious, the problem has nothing to do with Bing itself — it’s a technical problem on’s end.

Ian McAnerin noticed earlier today that doesn’t show up in Bing on searches for [open office] and []. He wonders if Bing is “allowing its results to be unduly influenced by either money or corporate policy.” But, upon further digging with some help from SEL’s Vanessa Fox, that’s not the case.

To be clear: Pages from the domain do show up in Bing — a [] search proves that. But the home page itself is nowhere to be found.

It seems as though the problem is simply due to a technical misconfiguration on the servers. This issue is impacting Yahoo’s index as well as Bing’s. When you navigate to as a user, you see the home page as you should. If you change the user agent to Googlebot (Vanessa used the User Agent Switcher Firefox plugin), you see the same nicely rendered home page.


However, if you change the user agent to either MSNbot or Yahoo Slurp, you see a 403 access denied error.


You can see this more clearly in the HTTP response from the server (using a tool such as the Live HTTP Headers Firefox plugin). Accessing the page as Googlebot returns the following (shortened for space; note the 304 rather than 200 response simply because Vanessa had visited the page before as Googlebot):

GET / HTTP/1.1
User-Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +
If-Modified-Since: Mon, 29 Mar 2010 12:58:51 GMT
HTTP/1.0 304 Not Modified

Whereas accessing the page as MSNbot looks like this:
GET / HTTP/1.1
User-Agent: msnbot/1.1 (+
HTTP/1.0 403 Forbidden

How did the server get set up this way? Any number of explanations are possible. Sometimes this happens when the host notices overactive crawling from particular bots and blocks them. This is always something that a site owner who uses shared hosting should watch out for (as the result is that your site gets dropped from that search engine’s index). In this case, Open Office likely manages their own servers, but they may not be blocking Microsoft and Yahoo purposely. A piece of server software could have easily been misconfigured accidentally.

A Microsoft spokesperson tells us: “We’re reaching out to them now to try and resolve the issue.”

Related Topics: Channel: SEO | Microsoft: Bing | SEO: Blocking Spiders


About The Author: is Editor-In-Chief of Search Engine Land. His news career includes time spent in TV, radio, and print journalism. His web career continues to include a small number of SEO and social media consulting clients, as well as regular speaking engagements at marketing events around the U.S. He recently launched a site dedicated to Google Glass called Glass Almanac and also blogs at Small Business Search Marketing. Matt can be found on Twitter at @MattMcGee and/or on Google Plus. You can read Matt's disclosures on his personal blog.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


Get all the top search stories emailed daily!  


Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.

Comments are closed.

Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide