uTest’s “Battle of the Search Engines” Tests Bugs
uTest released a study they named “Battle of the Search Engines” which measured the relevancy of Google, Yahoo, and Bing based on “search results accuracy, page load speed, real-time relevance and usability.” The report found that there were over 600 “bugs” found in the test. By “bug” I believe they mean links that lead to dead ends, i.e. broken links. I am not exactly sure how that measures “relevancy” of the search result, but it does tell us some things.
In any event, here are the key points from the survey:
- 71% of respondents stated search results accuracy as the most important when choosing their search engine.
- In overall accuracy, Google led the way with a top two box score (those rated as “excellent” or “good”) of 90%. Caffeine followed with 83%. Yahoo & Bing trailed with 53 and 42%, respectively.
- Bing had the most reported bugs; however, it scored very high for usability and pics/vids search
- More than 30% noted that Bing surprised them favorably; and 10% said that after testing all three engines, they would make Bing their default engine.
Here is the break down by search engine:
- 130 bugs reported
- 8 percent classified as “showstoppers”
- 28 percent were Technical, 46 percent were Functional, and 26 percent were GUI
- 321 bugs reported
- 14 percent classified as “showstoppers”
- 29 percent were Technical, 46 percent were Functional, and 25 percent were GUI
- 70 bugs reported
- 10 percent classified as “showstoppers” and 50 percent as “high severity”
- 28 percent were Technical, 57 percent were Functional, and 15 percent were GUI
For the full report, click here do download the PDF.
(Some images used under license from Shutterstock.com.)
The latest analyses, insights and strategies that inspire CMOs and marketers everywhere.