Search Engine Land
  • SEO
    • > All SEO
    • > What Is SEO?
    • > SEO Periodic Table
    • > Google: SEO
    • > Bing SEO
    • > Google Algorithm Updates
  • PPC
    • > All PPC
    • > What is PPC?
    • > Google Ads
    • > Microsoft Ads
    • > The Periodic Tables of PPC
  • Focuses
    • > Local
    • > Commerce
    • > Shopify SEO Guide
    • > Content
    • > Email Marketing Periodic Table
    • > Social Media Marketing
    • > Analytics
    • > Search Engine Land Awards
    • > All Focuses
  • SMX
  • Webinars
  • Intelligence Reports
  • White Papers
  • About
    • > About Search Engine Land
    • > Newsletter
    • > Third Door Media
    • > Advertise

Processing...Please wait.

Search Engine Land » Channel » SEO » Twitter’s New SEO Play: A Profile Directory Of All User Accounts

Twitter’s New SEO Play: A Profile Directory Of All User Accounts

Twitter has quietly launched a user profile directory that it hopes will bring it more search engine traffic. It’s Twitter’s second SEO play in recent weeks, coming on the heels of a change in its robots.txt file. With that change, Twitter made its content-based search results — i.e., search results for tweets and hashtags, but […]

Matt McGee on October 8, 2012 at 8:45 am

twitter-new-logo-2012Twitter has quietly launched a user profile directory that it hopes will bring it more search engine traffic.

It’s Twitter’s second SEO play in recent weeks, coming on the heels of a change in its robots.txt file. With that change, Twitter made its content-based search results — i.e., search results for tweets and hashtags, but not search results for users — crawlable.

With the new directory, Twitter is finishing that process by making its user profiles more discoverable by Google, Bing and other search engines. When asked why Twitter launched the user directory, a company spokesperson said it’s “to help people find the accounts they’re looking for with various search engines.”

Is The Directory Helping Twitter’s Search Visibility?

Twitter’s user directory has been online for a couple weeks. It’s essentially a master site map of Twitter accounts listed alphabetically and, from an SEO perspective, follows best practices by showing no more than 100 profile links per page.

As I write this, a Google search for site:twitter.com/i/directory/profiles gives a superficial display of 718,000 matching results. If I click through to reach the end of the 1,000 results that Google will show, I can reach page 47 before getting the “we have omitted some entries very similar to the 469 already displayed” message. And if I click to include the omitted results, I hit the end at page 57.

twitter-google-directory

The 718,000 results isn’t right because Twitter’s directory doesn’t have that many pages. If you estimate that Twitter has about five million total accounts, the directory — with 100 accounts per page — would be about 50,000 pages, far less than 718,000.

UPDATE: I incorrectly typed and used five million accounts in the paragraph above, when I should’ve used 500 million accounts. My apologies. Based on 500 million accounts, the Twitter directory would have as many as five million pages, which means Google’s count of 718,000 could be an accurate reflection of how many pages it knows about.

But even if Google has only indexed about 57 pages (and those numbers aren’t perfectly reliable since I could be hitting a certain datacenter that has fewer results), it’s still a lot more than Bing. My searches show that Bing has so far only indexed the Twitter directory home page.

bing-twitter-directory

I have to assume that Bing will eventually crawl much deeper into the directory; Bing has gone on record admitting that its bot is slow, and that’s certainly the case here.

Of course, many Twitter profile pages have been crawled and indexed by Google and Bing for a long time now, so it’s difficult to say if the new directory is helping (or will help) the search engines find new, unindexed profiles.

The Checkered Twitter/Google Search History

What’s interesting is how Twitter’s recent search- and SEO-friendly moves fit into its checkered relationship with Google.

Google and Twitter used to be on good terms. Google had access to the full “firehose” of tweets and was primarily using that to power its Google Realtime Search product. But that ended in July 2011, forcing Realtime Search offline. Google promised that it would resurrect Realtime Search, but that never happened.

The end of that agreement meant Google no longer had access to the firehose — a special API feed of tweets — but Google was still able to do its regular crawl of Twitter profiles and content.

Except there was one temporary problem: Around the same time, in the summer of 2011, Twitter wasn’t very SEO-friendly. As we reported, Twitter was having technical infrastructure problems that hindered Google’s ability to crawl and index its site. Whoops.

In fact, Google says that it was cut entirely off from Twitter for a time. Here’s the head of Google’s search efforts Amit Singhal talking about the issue (at 1:35 in) earlier this year at our SMX London conference, as well as the challenge in crawling Twitter without a deal:

[youtube width=”560″ height=”315″]http://www.youtube.com/watch?v=PVzM4n1I-vM&t=1m38s[/youtube]

Twitter eventually fixed those issues, but its relationship with Google has been strained ever since the end of the companies’ agreement. In January, Twitter came out firing when Google launched its Search Plus Your World product, accusing Google of favoring its own social content ahead of Twitter (and other social content).

Google’s response then — and many times since — has been to mention how Twitter turned off the firehose and isn’t giving Google direct access to its content anymore. But Twitter engineers joined with peers at Facebook and MySpace to create a “Don’t Be Evil” tool that showed how easily Google could surface Twitter (and other social) content without firehose access. For more on that, see this recap of Danny Sullivan’s conversation with Google’s Eric Schmidt from January.

So today, while the war of words between Google and Twitter has died down, we now see Twitter taking a much more proactive approach to search engines — first with the robots.txt change and now with the SEO-friendly user directory.

For more on the directory itself and how it works, see my companion article on Marketing Land, Twitter Quietly Launches A User Directory.


Opinions expressed in this article are those of the guest author and not necessarily Search Engine Land. Staff authors are listed here.


New on Search Engine Land

    4 elements of good content, according to Google research 

    Google Ads bug inflating some cost-per-click (CPCs) for non-US campaigns

    3 changes coming to Google Ads audience features

    Chrome will show Google Lens results in the same browser tab

    Google Marketing Live 2022: Everything you need to know

About The Author

Matt McGee
Matt McGee joined Third Door Media as a writer/reporter/editor in September 2008. He served as Editor-In-Chief from January 2013 until his departure in July 2017. He can be found on Twitter at @MattMcGee.

Related Topics

SEOSocialTwitter

Get the daily newsletter search marketers rely on.

Processing...Please wait.

See terms.

ATTEND OUR EVENTS

Learn actionable search marketing tactics that can help you drive more traffic, leads, and revenue.

March 8-9, 2022: Master Classes (virtual)

June 14-15, 2022: SMX Advanced (virtual)

November 15-16, 2022: SMX Next (virtual)

Learn More About Our SMX Events

Discover time-saving technologies and actionable tactics that can help you overcome crucial marketing challenges.

Start Discovering Now: Spring (virtual)

September 28-29, 2022: Fall (virtual)

Learn More About Our MarTech Events

Webinars

Take a Crawl, Walk, Run Approach to Multi-Channel ABM

Content Comes First: Transform Your Operations With DAM

Dominate Your Competition with Google Auction Insights and Search Intelligence

See More Webinars

Intelligence Reports

Enterprise SEO Platforms: A Marketer’s Guide

Enterprise Identity Resolution Platforms

Email Marketing Platforms: A Marketer’s Guide

Enterprise Sales Enablement Platforms: A Marketer’s Guide

Enterprise Digital Experience Platforms: A Marketer’s Guide

Enterprise Call Analytics Platforms: A Marketer’s Guide

See More Intelligence Reports

White Papers

Reputation Management For Healthcare Organizations

Unlock the App Marketing Potential of QR Codes

Realising the power of virtual events for demand generation

The Progressive Marketer’s Ultimate Events Strategy 2022 Worksheet

CMO Guide: How to Plan Smart and Pivot Fast

See More Whitepapers

Receive daily search news and analysis.

Processing...Please wait.

Topics

  • SEO
  • PPC

Our Events

  • Search Marketing Expo - SMX
  • MarTech

About

  • About Us
  • Contact
  • Privacy
  • Marketing Opportunities
  • Staff

Follow Us

  • Facebook
  • Twitter
  • LinkedIn
  • Newsletters
  • RSS
  • Youtube

© 2022 Third Door Media, Inc. All rights reserved.