• Search Engine Land
  • Sections
    • SEO
    • SEM
    • Local
    • Retail
    • Google
    • Bing
    • Social
    • Resources
    • More
    • Home
  • Search Engine Land
  • SEO
  • SEM
  • Local
  • Retail
  • Google
  • Bing
  • Social
  • Resources
  • Live
  • More
  • Events
  • SUBSCRIBE

Search Engine Land

Search Engine Land
  • SEO
  • SEM
  • Local
  • Retail
  • Google
  • Bing
  • Social
  • Resources
  • More
  • Newsletters
  • Home
Mobile

Cortana Everywhere: Speech-Driven Digital Assistants As The New Universal UI

Microsoft's Project Oxford offers bundle of advanced tools and functionality to developers.

Greg Sterling on May 18, 2015 at 10:47 am
  • More
cortana-logo-1920

When the internet was younger, the search box was promoted as a kind of universal user interface. That was the mantra and marketing message of the former enterprise search company Fast Search & Transfer, which Microsoft acquired in 2008.

With the proliferation of smartphones, smartwatches and, soon, numerous other connected devices — the so-called “Internet of Things” — the familiar search box (and mouse and keyboard) will necessarily give way to speech or perhaps a digital assistants such as Cortana as a successor UI.

Microsoft is seeking to enable this with its ambitious Project Oxford, a set of APIs and SDKs for developers that enable them to add a range of advanced capabilities to their applications.

These tools include facial recognition APIs (most recently demonstrated in Microsoft’s viral How-Old.net), speech-to-text and text-to-speech processing in multiple languages, image recognition to identify objects and images and what the company calls “Language Understanding Intelligent Service” (LUIS). Unlike the others LUIS, which promises advanced natural language understanding and “intent detection,” is invitation only for now.

Project Oxford capabilites Microsoft

An article in Ars Technica goes into all this in some (technical) detail. But here’s the most important part of the article:

The longterm result could be that developers of all sorts of devices could build speech and computer vision into their products, delivering the equivalent of Cortana on everything from televisions to assembly line equipment to household automation systems. All such implementations would be customized to specific tasks and backed by cloud-based artificial intelligence.

This is what LUIS integration promises for developers:

Create models for your application to better understand intents like “turn on the lights”, or entities such as “start a new jog/walk/hike/bikeride”. Tune your model with in-depth performance visualizations . . .

Use the pre-built, world-class models to recognize entities like places, times, numbers, temperatures, and to also handle common requests like “set an alarm for 8 AM”. Immediately enable personal assistant functionalities by using a selection of Cortana understanding models.

The bottom line is that LUIS essentially enables Bing’s “intelligence engine” and Cortana-like capabilities to extend to any app on any device.

At its Build developer conference earlier this month Microsoft also announced deeper app integration into Cortana for task completion. Actions and tasks can thus be accomplished (e.g., call an Uber car) without launching the app in question. Google is doing something similar by integrating action buttons (i.e., “buy“) and transactional capabilities into search and Google Now.

The larger point here is that what we call “search” today is going to change radically over the next decade. Its impact on marketers and disciplines such as SEO will be profound, though is not entirely clear at this point. We can project, however, that the familiar “query in a box” and related SERP will likely become a less and less common way that people retrieve and interact with content over time.


Opinions expressed in this article are those of the guest author and not necessarily Search Engine Land. Staff authors are listed here.



About The Author

Greg Sterling
Greg Sterling is a Contributing Editor to Search Engine Land, a member of the programming team for SMX events and the VP, Market Insights at Uberall.

Related Topics

Bing Image SearchBing MobileChannel: Mobile

We're listening.

Have something to say about this article? Share it with us on Facebook, Twitter or our LinkedIn Group.

Get the daily newsletter search marketers rely on.

Processing...Please wait.

See terms.

ATTEND OUR EVENTS

Lorem ipsum doler this is promo text about SMX events.

Available On-Demand: SMX Create

May 18-19, 2021: SMX London

June 8-9, 2021: SMX Paris

June 15-16, 2021: SMX Advanced

June 21-22, 2021: SMX Advanced Europe

August 17, 2021: SMX Convert

November 9-10, 2021: SMX Next

December 14, 2021: SMX Code

Available On-Demand: SMX

Available On-Demand: SMX Report

×


Learn More About Our SMX Events

Discover actionable tactics that can help you overcome crucial marketing challenges. Our next conference will be held:

Next Event: Sept. 14-15, 2021

Available On-Demand: March 2021

Available On-Demand: October 2020

×

Attend MarTech - Click Here


Learn More About Our MarTech Events

White Papers

  • Gartner Magic Quadrant for Digital Experience Platforms
  • Selecting a Customer Data Platform For Your Organization: The 2020 Gartner Market Guide
  • The Complete Guide to Web Core Vitals
  • The New Era of Automation in SEO
  • Nielsen Annual Marketing Report: Era of Adaptation
See More Whitepapers

Webinars

  • Drive Customer Engagement with the Power of Personalization
  • 7 Use Cases That Prove Why You Should Implement DAM
  • Accelerate Your SEO & Content Marketing Program with 4 Key Milestones
See More Webinars

Research Reports

  • Local Marketing Solutions for Multi-Location Businesses
  • Enterprise Digital Asset Management Platforms
  • Identity Resolution Platforms
  • Customer Data Platforms
  • B2B Marketing Automation Platforms
  • Call Analytics Platforms
See More Research

Attend SMX For Only $199

h
Receive daily search news and analysis.

Channels

  • SEO
  • SEM
  • Local
  • Retail
  • Google
  • Bing
  • Social

Our Events

  • SMX
  • MarTech

Resources

  • White Papers
  • Research
  • Webinars

About

  • About Us
  • Contact
  • Privacy
  • Marketing Opportunities
  • Staff

Follow Us

  • Facebook
  • Twitter
  • LinkedIn
  • Newsletters
  • RSS
  • Youtube

© 2021 Third Door Media, Inc. All rights reserved.

Your privacy means the world to us. We share your personal information only when you give us explicit permission to do so, and confirm we have your permission each time. Learn more by viewing our privacy policy.Ok