• Search Engine Land
  • Sections
    • SEO
    • SEM
    • Local
    • Retail
    • Google
    • Bing
    • Social
    • Resources
    • More
    • Home
  • Follow Us
    • Follow
  • Search Engine Land
  • SEO
  • SEM
  • Local
  • Retail
  • Google
  • Bing
  • Social
  • Resources
  • Live
  • More
  • Events
    • Follow
  • SUBSCRIBE

Search Engine Land

Search Engine Land
  • SEO
  • SEM
  • Local
  • Retail
  • Google
  • Bing
  • Social
  • Resources
  • More
  • Newsletters
  • Home
Consumer

Google Paper: Better Image Search Though VisualRank / Image Rank

A Google Prototype for a Precision Image Search from the New York Times covers a new research paper (PDF format) from Google that talks about a way of ranking images based on analyzing "visual links" between them. Image search at the major search engines today largely relies on looking at words that are used around […]

Danny Sullivan on April 28, 2008 at 5:24 am
  • More

Visual Rank Example


A Google Prototype for a Precision Image Search
from the New York Times
covers a new research
paper
(PDF format) from Google that talks about a way of ranking images based
on analyzing "visual links" between them.

Image search at the major search engines today largely relies on looking at
words that are used around images — on the pages that host them, in image file
names, and in ALT text associated with them. No real image recognition is done by
any of the majors. Search for "apples," and they haven’t actually somehow
scanned the images itself to "see" if they contain pictures of apples.

The method in Google’s paper changes that. In short, a group of images
retrieved for a query using traditional search methods is then further analyzed.
Image recognition software finds which images in the group seem most similar to
each other. It then estimates "visual hyperlinks" between them to produce a
final ranking.

The last part is important. No actual hyperlinks on the web are used to rank
the images, if I understand the paper correctly, other than in the first
traditional retrieval process. Instead, the algorithm guesses at how the images
would be linked together, with those being most similar having more virtual
links to each other. As a result, the most "linked to" images are calculated to
rank first.

The image above comes from the paper and shows examples of images found in a
search for [mona lisa]. The lines illustrate how they are all estimated to link
together, with the two in the middle (as shown in the close-up below) deemed the
most relevant based on linkage:


Visual Rank Example

The New York Times article says the researchers call the method "VisualRank,"
though that term is not used in the actual paper, which is entitled "PageRank for
Product Image Search," coming from how the method was applied to product search
results as a test. The paper itself talks of Image Rank at one point, so
VisualRank might be a new name the researchers are trying out.

Image recognition isn’t new or unique to Google, though this twist on using
virtual hyperlinks is. For background on what others are doing, see
Teaching Google To See
Images
from Chris Sherman last year. It covers players such as Riya. My
article on Polar Rose,
Polar Rose Promising Face Recognition Image Search
, also provides some
further background on image recognition as well as the
Google Images Labeler that
relies on human judgment to identify image.

For further discussion,
see Techmeme
.



About The Author

Danny Sullivan
Danny Sullivan was a journalist and analyst who covered the digital and search marketing space from 1996 through 2017. He was also a cofounder of Third Door Media, which publishes Search Engine Land, Marketing Land, MarTech Today and produces the SMX: Search Marketing Expo and MarTech events. He retired from journalism and Third Door Media in June 2017. You can learn more about him on his personal site & blog He can also be found on Facebook and Twitter.

Related Topics

Channel: ConsumerGoogle: ImagesSearch Engines: Photo & Image Search

We're listening.

Have something to say about this article? Share it with us on Facebook, Twitter or our LinkedIn Group.

Get the daily newsletter search marketers rely on.
See terms.

ATTEND OUR EVENTS

Lorem ipsum doler this is promo text about SMX events.

February 23, 2021: SMX Report

April 13, 2021: SMX Create

May 18-19, 2021: SMX London

June 8-9, 2021: SMX Paris

June 15-16, 2021: SMX Advanced

August 17, 2021: SMX Convert

November 9-10, 2021: SMX Next

October 2021: SMX Advanced Europe

December 17, 2021: SMX Code

Available On-Demand: SMX

×


Learn More About Our SMX Events

Discover actionable tactics that can help you overcome crucial marketing challenges. Our next conference will be held:

MarTech 2021: March 16-17

MarTech 2021: Sept. 14-15

MarTech 2020: Watch On-Demand

×

Attend MarTech - Click Here


Learn More About Our MarTech Events

White Papers

  • 6 Powerful Ways Experience Analytics Can Help Your Business Now
  • Email Tune-Up: A 5-Point Inspection to Get Your Program in Gear
  • Digital Marketing Report Q4 2020: Benchmarks and Insights for 2021
  • Data SEO – The Next Big Adventure
  • Getting Started with Email Marketing Automation
See More Whitepapers

Webinars

  • How to Avoid the Digital Transformation Trap
  • How to Build a Marketing System of Record
  • Meet BIMI: The brand-boosting email security marketers must have for 2021
See More Webinars

Research Reports

  • Local Marketing Solutions for Multi-Location Businesses
  • Enterprise Digital Asset Management Platforms
  • Identity Resolution Platforms
  • Customer Data Platforms
  • B2B Marketing Automation Platforms
  • Call Analytics Platforms
See More Research

h
Receive daily search news and analysis.
Search Engine Land
Download the Search Engine Land App on iTunes Download the Search Engine Land App on Google Play

Channels

  • SEO
  • SEM
  • Local
  • Retail
  • Google
  • Bing
  • Social

Our Events

  • SMX
  • MarTech

Resources

  • White Papers
  • Research
  • Webinars
  • Search Marketing Expo
  • MarTech Conference

About

  • About Us
  • Contact
  • Privacy
  • Marketing Opportunities
  • Staff
  • Connect With Us

Follow Us

  • Facebook
  • Twitter
  • LinkedIn
  • Newsletters
  • Instagram
  • RSS
  • Youtube
  • iOS App
  • Google Play

© 2021 Third Door Media, Inc. All rights reserved.

Your privacy means the world to us. We share your personal information only when you give us explicit permission to do so, and confirm we have your permission each time. Learn more by viewing our privacy policy.Ok