The Human Side To Google: Search Evaluations

Google’s next blog post regarding web search is about search evaluation, basically how Google measures quality. Scott Huffman, an Engineering Director who is responsible for leading search evaluation, wrote the blog post.

In short, he explained that the evaluation process is comprised of two main elements:

(1) Human evaluators, actual people around the world trained to rate search results and search UI and experience. We actually covered the Google Quality Raters Handbook over a year ago, which had many details on the training materials for these human evaluators. There are estimated to be over 10,000 evaluators and if you see in your logs, it might be one of those evaluators on your site. (2) Live traffic experiments, which is us, you and me. Google plants tests on a small fraction of their users, collects data and sees if they improve or hurt the quality of the search results or search experience. That is why we often blog about user interface tests and changes, before everyone sees them, because Google is testing things out on a small user base to decide if they want to make that new UI or Google results available to everyone.

In any event, Scott goes through more of the search evaluation process at his blog post at the Google Blog.

Related Topics: Channel: Consumer | Google: User Interface | Google: Web Search


About The Author: is Search Engine Land's News Editor and owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry's personal blog is named Cartoon Barry and he can be followed on Twitter here. For more background information on Barry, see his full bio over here.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


Get all the top search stories emailed daily!  


Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.

Comments are closed.

Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide