Analyst Gives Both Google Now And Siri A “C+”

apple-siriPiper Jaffray financial analyst Gene Munster performed his now annual comparison of Google Voice Search/Google Now and Siri to determine which one performed better. Using 800 queries under a variety of “controlled” and “uncontrolled” conditions, Munster and his team tested and compared the two “assistants.”

Munster gave Google Voice Search/Now a C+, an improvement from the D- it received a year ago. Siri received the identical C+ grade, up slightly from a C last year.

It may well be that Google Voice Search/Now and Siri have achieved some level of parity in their ability to understand and answer questions. However Munster’s past and current analyses are sloppy in many respects. Google Voice Search and Google Now are distinct things. And currently Apple offers nothing like Google Now.

Here are the Piper Jaffray report cards for Siri and Google:

Google vs. Siri

Source: Piper Jaffray

It’s probably the case that Munster is using the term “Google Now” to describe the mix of functions comprising Google Voice Search and Google’s Knowledge Graph. Mostly what he appears to be testing is Google Voice Search and resulting answers.

Google Voice Search is a substitute input mechanism. However “Google Now,” in actuality, combines a variety of signals including location, time of day and a range of user data (i.e., Gmail, calendar, search history) to provide “predictive” or “anticipatory” search results. While Apple/Siri may seek to develop some sort of predictive or anticipatory capability in the future, iOS has nothing like Google Now today.

Google recently introduced a follow-up “conversational” capability for voice dictation on mobile devices. And Google demonstrated “conversational search” at its developer conference earlier this year. However Siri still leads in its ability to “understand” questions and requests. By contrast, Google has a vastly better database/index of information and can deliver better results in many instances in response to the same voice input (maps is one example).

In my testing and experience, not as systematic as the Piper Jaffray example above, I have found that Nuance (which is behind Siri’s speech recognition) is consistently more accurate than Google speech recognition, especially for dictation and longer queries. However I was with the founder of “anticipatory search” technology provider Expect Labs a couple of days ago and he was arguing that Google speech recognition was improving dramatically and would likely exceed Nuance’s accuracy in the not-too-distant future.

Stepping back from the Google vs. Siri debate the more profound development is that the “virtual assistant” competition between Google, Apple and others in the enterprise (e.g., IBM’s Watson) is previewing the future of computing and search, where an increasingly broad and rich set of signals generate much more narrowly tailored results or “answers” vs. today’s “ten blue links.”

In addition, input mechanisms such as voice are fundamentally changing our expectations and the way we interact with “search.” The Star Trek computer is indeed on the horizon.

Related Topics: Apple | Apple: Siri | Channel: Consumer | Google: Google Now | Google: Knowledge Graph | Google: Mobile | Top News

Sponsored


About The Author: is a Contributing Editor at Search Engine Land. He writes a personal blog Screenwerk, about SoLoMo issues and connecting the dots between online and offline. He also posts at Internet2Go, which is focused on the mobile Internet. Follow him @gsterling.

Connect with the author via: Email | Twitter | Google+ | LinkedIn



SearchCap:

Get all the top search stories emailed daily!  

Share

Other ways to share:
 

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.
  • RyanMJones

    rated them the same? he’s doing it wrong. You have to rate one way higher than the other to create controversy and get more pageviews, Isn’t that how research works now?

    On a serious note, it is interesting to see how they advance – especially as more voice activated technology hits the market (glass, watches, whatever TV apple hasn’t released yet)

  • gregsterling

    Yes the thing to pay attention to is the broader development of voice + AI + context

  • RyanMJones

    I still want to be able to say “Ok Google, record the Lions game” on my phone, and my TV just does it.

  • gregsterling

    I suspect one day in the not-too-distant future you will be able to. Google is apparently developing a set-top box, which will undoubtedly integrate with Android smartphones.

  • Mark Coppock

    The distinction between Google Voice Search and Google Now is an important one. They really are different, and the latter is amazing (including its ability to gather up searches and context from other devices).

  • RyanMJones

    saw that. Side note: I hate the word “set-top” Most tv set tops are about 1 inch wide. that’d have to be one really tiny box.

  • SpeechGuy

    Ryan’s point leads to the future of personal assistant technology, the ubiquitous personal assistant that follows you across devices, and makes the OSes and devices all feel like one thing. Google, Siri, and Samsung (using its Nuance-powered S-Voice on Galaxy phones) are in the running to control this, particularly since it has deep implications for advertising revenues.

  • http://www.eBizROI.com Rick Noel, eBiz ROI, Inc.

    Interesting study Greg. Thanks for the differentiation of Google Now vs. Google Voice Search. I propose a new Final Jeopardy with IBM Watson, Siri and Google Now in a machine only field.

Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest

 
 

Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States

Europe

Australia & China

Learn more about: SMX | MarTech


Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!

 


 

Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide