Google AI Mode lets you ask questions with images

Google has added multimodal capabilities to its new AI Mode feature, letting you ask your questions with the assistance of uploading an image. Plus, Google announced it is rolling out AI Mode to millions of more Labs users in the U.S.

AI mode with images. Google AI Mode now lets you upload an image via upload or your camera to ask AI Mode questions with images. Google calls this multimodal capabilities, which is launched years ago in other areas of Search.

“With AI Mode’s new multimodal understanding, you can snap a photo or upload an image, ask a question about it and get a rich, comprehensive response with links to dive deeper,” Robby Stein, VP of Product, Google Search wrote. He added:

“AI Mode builds on our years of work on visual search and takes it a step further. With Gemini’s multimodal capabilities, AI Mode can understand the entire scene in an image, including the context of how objects relate to one another and their unique materials, colors, shapes and arrangements. Drawing on our deep visual search expertise, Lens precisely identifies each object in the image. Using our query fan-out technique, AI Mode then issues multiple queries about the image as a whole and the objects within the image, accessing more breadth and depth of information than a traditional search on Google. The result is a response that’s incredibly nuanced and contextually relevant, so you take the next step.”

What it looks like. Here is what it looks like in action:

Millions more gain access to AI Mode. Google said, “we’ve now started to make AI Mode available to millions more Labs users in the U.S.” I mean, I am not sure if this is new. We saw Google expand access to those who do not have Google One AI Premium subscriptions a couple of weeks ago. And then last week, Google invited a third batch of users to AI Mode.

So maybe Google is opening up a fourth batch of invites today?

Why we care. Google’s new AI Mode does feel like the future of search, in many ways. So it is important that you all try it out as soon as you can, and watch it as it adapts.

Soon you may all be looking for ways to get traffic from AI Mode as opposed to just Google Search and AI Overviews.