uTest’s “Battle of the Search Engines” Tests Bugs

uTest released a study they named “Battle of the Search Engines” which measured the relevancy of Google, Yahoo, and Bing based on “search results accuracy, page load speed, real-time relevance and usability.” The report found that there were over 600 “bugs” found in the test. By “bug” I believe they mean links that lead to dead ends, i.e. broken links. I am not exactly sure how that measures “relevancy” of the search result, but it does tell us some things.

In any event, here are the key points from the survey:

  • 71% of respondents stated search results accuracy as the most important when choosing their search engine.
  • In overall accuracy, Google led the way with a top two box score (those rated as “excellent” or “good”) of 90%. Caffeine followed with 83%. Yahoo & Bing trailed with 53 and 42%, respectively.
  • Bing had the most reported bugs; however, it scored very high for usability and pics/vids search
  • More than 30% noted that Bing surprised them favorably; and 10% said that after testing all three engines, they would make Bing their default engine.

Here is the break down by search engine:


  • 130 bugs reported
  • 8 percent classified as “showstoppers”
  • 28 percent were Technical, 46 percent were Functional, and 26 percent were GUI


  • 321 bugs reported
  • 14 percent classified as “showstoppers”
  • 29 percent were Technical, 46 percent were Functional, and 25 percent were GUI


  • 70 bugs reported
  • 10 percent classified as “showstoppers” and 50 percent as “high severity”
  • 28 percent were Technical, 57 percent were Functional, and 15 percent were GUI

For the full report, click here do download the PDF.

Related Topics: Channel: Strategy | Stats: Relevancy


About The Author: is Search Engine Land's News Editor and owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry's personal blog is named Cartoon Barry and he can be followed on Twitter here. For more background information on Barry, see his full bio over here.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


Get all the top search stories emailed daily!  


Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.
  • JustinGoldberg

    The Bing image search is probably human edited, which just does’t scale well.

    For an accurate, non-biased comparison try this out,


Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide