uTest’s “Battle of the Search Engines” Tests Bugs

uTest released a study they named “Battle of the Search Engines” which measured the relevancy of Google, Yahoo, and Bing based on “search results accuracy, page load speed, real-time relevance and usability.” The report found that there were over 600 “bugs” found in the test. By “bug” I believe they mean links that lead to dead ends, i.e. broken links. I am not exactly sure how that measures “relevancy” of the search result, but it does tell us some things.

In any event, here are the key points from the survey:

  • 71% of respondents stated search results accuracy as the most important when choosing their search engine.
  • In overall accuracy, Google led the way with a top two box score (those rated as “excellent” or “good”) of 90%. Caffeine followed with 83%. Yahoo & Bing trailed with 53 and 42%, respectively.
  • Bing had the most reported bugs; however, it scored very high for usability and pics/vids search
  • More than 30% noted that Bing surprised them favorably; and 10% said that after testing all three engines, they would make Bing their default engine.

Here is the break down by search engine:

Google

  • 130 bugs reported
  • 8 percent classified as “showstoppers”
  • 28 percent were Technical, 46 percent were Functional, and 26 percent were GUI

Bing

  • 321 bugs reported
  • 14 percent classified as “showstoppers”
  • 29 percent were Technical, 46 percent were Functional, and 25 percent were GUI

Yahoo

  • 70 bugs reported
  • 10 percent classified as “showstoppers” and 50 percent as “high severity”
  • 28 percent were Technical, 57 percent were Functional, and 15 percent were GUI

For the full report, click here do download the PDF.

Related Topics: Channel: Strategy | Stats: Relevancy


About The Author: is Search Engine Land's News Editor and owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry's personal blog is named Cartoon Barry and he can be followed on Twitter here. For more background information on Barry, see his full bio over here.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


SMX - Search Marketing Expo

SearchCap:

Get all the top search stories emailed daily!  

Like This Story? Please Share!

Other ways to share:

Like Our Site? Follow Us!

Subscribe to Our Feed! Join our LinkedIn Group Check out our Tumblr! See us on Pinterest Get Search Engine Land on your mobile device!
 

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.
  • JustinGoldberg

    The Bing image search is probably human edited, which just does’t scale well.

    For an accurate, non-biased comparison try this out,

    http://blindsearch.fejus.com/

Get Our News, Everywhere!

 
  • Advertise With Us
 

Click to watch SMX conference video

Join us at an upcoming SMX event:

North America

EMEA

APAC

Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.

SMX Site » | SMX Difference » | SMX News »




 

Search Engine Land Periodic Table of SEO Ranking Factors

Get Your Copy
Read The Full SEO Guide