Google Scientist: We Want To Be Able To Respond To A Query Like “Book Me A Trip To Washington, DC”

Google logoWill the day come that Google can successfully respond when you tell it something like, “Book me a trip to Washington, DC” — walking you through all the queries and answers needed to complete such a complex request?

Will the day come when we’re using devices that only offer voice-based search?

Will the day come when visual search happens continuously via the camera on Google Glass?

Those are some of the search-based challenges that Google is working on, and they’re discussed in a recent interview that offers a peek at what Google thinks search will be like in the next decade. Or maybe “plans for search to be like” would be a more accurate phrase.

Google Research Fellow Jeff Dean discusses these topics and more in a recent interview with the Puget Sound Business Journal. He’s been with the company since 1999 and works in the Systems Infrastructure Group, where they do things like apply machine learning to search (and pretty much all of Google’s other products).

It’s pretty high-level stuff; you won’t find anything about keyword research or SEO or even the basics like “10 blue links” on a search results page. But you will find, for example, a peek at how Google is using machine learning to build out the Knowledge Graph.

We have the start of being able to do a kind of mixing of supervised and unsupervised learning, and if we can get that working well, that will be pretty important. In almost all cases you don’t have as much labeled data as you’d really like. And being able to take advantage of the unlabeled data would probably improve our performance by an order of magnitude on the metrics we care about. You’re always going to have 100x, 1000x as much unlabeled data as labeled data, so being able to use that is going to be really important.

Dean goes on to say that his team is working on “big problems” like being able to use voice and predictive search to answer queries like “Please book me a trip to Washington, DC.”

That’s a very high-level set of instructions. And if you’re a human, you’d ask me a bunch of follow-up questions, “What hotel do you want to stay at?” “Do you mind a layover?” – that sort of thing. I don’t think we have a good idea of how to break it down into a set of follow-up questions to make a manageable process for a computer to solve that problem. The search team often talks about this as the “conversational search problem.”

Google launched conversational search on its Chrome browser earlier this year, and the product is smart enough to follow a spoken sequence of searches like “how old is Barack Obama” followed by “how tall is he.” It recognizes that the “he” in the second spoken query refers to Obama.

Dean also mentions applying conversational search alongside Google Now, its predictive search tool.

Like, if it’s trying to give me restaurant reviews, there’s probably 50 possible restaurants to choose. And they might all be pretty good suggestions because it knows what sorts of food I like, but it’s still a list of 50 restaurants. Again, this would be a place where a dialog would be useful. “Are you in the mood for Italian?” Something like that.

He also talks about having devices a few years from now where voice is the only type of search offered, and about Google Glass offering augmented reality-style search where information is displayed automatically about buildings and signs that its camera sees.

If you want to spend some time thinking about where Google is taking search, it’s an interview that’s well worth reading.

Related Topics: Channel: SEO | Features: General | Google | Google: Conversational Search | Google: Google Now | Google: Knowledge Graph | Google: Web Search | Top News


About The Author: is Editor-In-Chief of Search Engine Land. His news career includes time spent in TV, radio, and print journalism. His web career continues to include a small number of SEO and social media consulting clients, as well as regular speaking engagements at marketing events around the U.S. He recently launched a site dedicated to Google Glass called Glass Almanac and also blogs at Small Business Search Marketing. Matt can be found on Twitter at @MattMcGee and/or on Google Plus. You can read Matt's disclosures on his personal blog.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


Get all the top search stories emailed daily!  


Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.
  • alisha652

    what Sharon responded I didnt even know that a single mom can profit $5397 in 4 weeks on the internet. did you look at this webpage w­w­w.K­E­P­2.c­o­m

  • George Michie

    Good write up, Matt. The notion of the automated personal assistant isn’t new, but they are definitely making progress. It’s incredibly difficult to understand the right followup questions for every situation. “I want a black dress” — What’s the occasion, what’s the price range, style, etc. Figuring out how to prioritize questions in all situations is really hard. Faceted navigation on websites for furniture, apparel, games, lawn care, service companies etc are all different. Big challenge.

  • Takeshi Young

    Those seem like cool features, but is that really the future of Google? It seems more in line with a feature that Yelp or Facebook would provide.

    Moreover, people use Google for more than just finding answers to simple questions… people use it to search the web and find other websites to visit. Google seems to be making the mistake of trying to make itself a destination, like early search engines did. And they’re doing it by scraping content from other websites for free. Content creators are going to rebel, if Google keeps hoarding all the traffic.

  • Charles Floate

    “Book me a trip to Washington” – Steals someones phone and can now steal their credit card hooked to their phone to? o.O

  • AdMamu

    Excellent, probably the classified sites may need to have intelligence to convert the voice to text and search. One results are found, again possibility to convert into voice and inform to the customer…i see this happening very soon…


  • Ashish Ahuja

    The day that is achieved there would be no privacy left

  • Jeff H

    Does anyone like calling into the electric company and being asked to sit through 10 questions. NO. Would someone really plan a vacation under these conditions. NO. Your eyes can scan through information much faster. Google is turning into a black hat spammer, they grab up all your data add no value and then make you pay to show up on their results because everyone uses Google.

Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide