The Human Side To Google: Search Evaluations
Sep 16, 2008 at 9:12am ET by Barry Schwartz
Google’s next blog post regarding web search is about search evaluation, basically how Google measures quality. Scott Huffman, an Engineering Director who is responsible for leading search evaluation, wrote the blog post.
In short, he explained that the evaluation process is comprised of two main elements:
(1) Human evaluators, actual people around the world trained to rate search results and search UI and experience. We actually covered the Google Quality Raters Handbook over a year ago, which had many details on the training materials for these human evaluators. There are estimated to be over 10,000 evaluators and if you see cart.corp.google.com in your logs, it might be one of those evaluators on your site. (2) Live traffic experiments, which is us, you and me. Google plants tests on a small fraction of their users, collects data and sees if they improve or hurt the quality of the search results or search experience. That is why we often blog about user interface tests and changes, before everyone sees them, because Google is testing things out on a small user base to decide if they want to make that new UI or Google results available to everyone.
In any event, Scott goes through more of the search evaluation process at his blog post at the Google Blog.
Share, Bookmark & Discuss This Article
More:
Keep Updated: News Via Email | News Via RSS Feed | News Via Twitter
See more stories like this in the Members Library! Check out the Google: User Interface, Google: Web Search sections of the Members Library where this story is filed. Members also get access to exclusive video content, a members-only weekly & monthly newsletter, plus more. Check out all the benefits!
TOP STORIES
SEARCH NEWS BRIEFS
FEATURES & ANALYSIS
RECENT COMMENTS
- dian said " I haven't tried that yet but if it is the way Mazter is saying I think it won't going to do any good"
- dian said " It really helps me a lot. The methods step by step explained the important factors easily and all th"
- T Campbell said " Ah, that's SPIDER-Man, said the comics guy."
FREE DAILY SEARCH NEWS RECAP!
Stay on top of all the search news with our daily summary, the SearchCap newsletter. View a sample ›
STAY CURRENT THROUGHOUT THE DAY
Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.
SMX Web Site » | SMX Difference » | SMX News »
Join us at an upcoming SMX event:
- SMX West - March 2-4, 2010
- SMX Munich - March 23-24, 2010
- SMX Toronto - April 8-9, 2010
- SMX Sydney - April 22-23, 2010
- SMX Advanced London - May 17-18, 2010
- SMX Advanced Seattle - June 8-9, 2010
- SMX East - October 4-6, 2010
- SMX Stockholm - October, 2010
Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:
- Making Online Marketing Relevant and Responsive: Tactics and A Tool for Success - November 17, 2009
- Ask the Search Engines: War Stories from the World Tour - December 1, 2009
- Turning Clients Into PPC Champions: How to Make PPC Meaningful to "the Other Guys" - December 8, 2009
TRACK US SOCIALLY
- Wall Street Journal Recommended Reading
- Ad Age Power 150 Blog
- Technorati Top 100 Blog
- Techmeme Leaderboard Source
- Best Search Engine Community/Forum
Featured sites from our Blogroll
- AOL Hot Searches
- Small Business SEM
- Google Operating System
- Yahoo! Search Marketing Blog
- Inside AdSense
Get Your Search Engine Land
Premium Membership!
Become a premium member today and receive:
- Express commenting privileges & photo.
- Exclusive videos & newsletters.
- Discounts to our SMX conferences.
- Access to "How To" & Other Archives.
© 2009 Third Door Media, Inc. All rights reserved. Google, Yahoo & Microsoft logos trademark respective companies and used with permission.
