Disturbing Michelle Obama Image Makes A Case For Facial Recognition In Google’s New Image Search

Do you remember that disturbing, Photoshopped image of First Lady Michelle Obama that made big news a couple years ago? It’s hard to find now in Google Image Search unless you know exactly what to type into the search box. Type “michelle obama” and you probably won’t ever see it. (More on that at the end.)

But if you upload the right photo (or wrong photo, as the case may be) of Michelle Obama into Google’s new Search By Image tool, that disturbing image shows up front and center among Google’s search results.


(Note: We’ve blocked the offending image so as to not give its creators the pleasure of more exposure.)

What’s happening here? A Google spokesperson talked to us about this specific search result, and we learned a couple things:

1. As Google first mentioned at Tuesday’s “Inside Search” event, the company isn’t using facial recognition in the Search By Image tool.

2. The Search By Image algorithm is looking at other things in the uploaded photo — the general shapes and proportions of what’s shown in the image, the colors, the outlines of Obama’s hair and clothing, and so forth.

It makes sense: Because the creators of the offensive image only changed her facial features from the image that I uploaded, and because Google isn’t using facial recognition, the Search By Image algorithm is actually making what I’d call the correct match. Without facial recognition, the disturbing image is essentially the same as the real image that I uploaded.

Will Search History Be Repeated?

Back in 2009, Google initially removed the offending image because it was hosted on a site that was serving malware, which is against Google’s terms of service. But the image showed up on other, “clean” sites and quickly made its way back into the image search results. That prompted Google to buy ads against the search term “michelle obama” to explain to users why search results are sometimes offensive.

Speaking about the Search By Image case above, Google wouldn’t speculate if they’d run similar ads now. The spokesperson said that Google views these as two very different cases: In 2009, an offensive image was being shown for a very broad text query (“michelle obama”). In this case, an offensive image is being shown in response to a very specific, user-uploaded image — an image that is closely associated to the offensive version.

In fact, the offensive image matches the original in every way but one: the First Lady’s face. And without using facial recognition, there’s no way for Google to distinguish between the two.

One Final Note

Back to that first paragraph: If you’re wondering why the offensive image doesn’t show up anymore on searches for “michelle obama,” Google says it’s because of algorithmic improvements, not any specific filtering on her name. The spokesperson said that the company’s internal metrics show that they’re doing a much better job of identifying the authoritativeness of individual images — and the offensive image is not authoritative for Michelle Obama’s name.

P.S. See Should Rick Santorum’s “Google Problem” Be Fixed? for a look at how this case compared to Rick Santorum’s “Google Problem.”

Related Topics: Channel: Consumer | Features: General | Google: Images | Top News


About The Author: is Editor-In-Chief of Search Engine Land. His news career includes time spent in TV, radio, and print journalism. His web career continues to include a small number of SEO and social media consulting clients, as well as regular speaking engagements at marketing events around the U.S. He recently launched a site dedicated to Google Glass called Glass Almanac and also blogs at Small Business Search Marketing. Matt can be found on Twitter at @MattMcGee and/or on Google Plus. You can read Matt's disclosures on his personal blog.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


Get all the top search stories emailed daily!  


Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. Comments may also be removed if they are posted from anonymous accounts. You can read more about our comments policy here.
  • http://mobiabc.com M.A.

    We have a say in Image Facial Recognition ! Google allows you to “Report Offensive Images”. The right thing to do would be for all of us to click on the “report” link at the bottom of disgraceful images and get rid of them.

  • captwasabi

    But what constitutes an offensive image? All the “Report Offensive Image” does is allow the mob to rule. If you are to allow freedom of speech then you must also allow for offense. For a company with a motto of “Don’t Be Evil” to censor is offensive. The best option would be to still allow the “Report Offensive Image” but also create a filter for the individual user. That way the user can decide if they want to see “offensive” images or not. This way the user is protected and the full spectrum of human knowledge, both good and bad, is still accessible.

  • http://ProperPlus.co.uk Jacob Wilson

    Well, you got her damn name into the search box. you dont even need a photo search to have these results…

Get Our News, Everywhere!

Daily Email:

Follow Search Engine Land on Twitter @sengineland Like Search Engine Land on Facebook Follow Search Engine Land on Google+ Get the Search Engine Land Feed Connect with Search Engine Land on LinkedIn Check out our Tumblr! See us on Pinterest


Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States


Australia & China

Learn more about: SMX | MarTech

Free Daily Search News Recap!

SearchCap is a once-per-day newsletter update - sign up below and get the news delivered to you!



Search Engine Land Periodic Table of SEO Success Factors

Get Your Copy
Read The Full SEO Guide