Twitter Search To Crawl Links & Add Ranking Algorithm

May 7, 2009 at 9:30am ET by Barry Schwartz

Cool changes coming to Twitter Search from News.com reports Twitter will be improving Twitter Search to index content beyond Twitter.com by crawling links within Twitter posts and also by adding a ranking algorithm to the search results.

In a one-to-one conversation with News.com’s Rafe Needleman and Twitter’s new VP of Operations, Santosh Jayaram – who was previously the VP of Search Quality for Google, Needleman uncovered some new and exciting features coming soon to Twitter.

Twitter Search is currently just a text matching search engine, it finds keywords based on the text of the most recent Tweet. Often, the search results can be repetitive or duplicate, plus not exactly a 100% relevant all the time. Jayaram hopes to change all that by taking Twitter Search beyond the current Twitter content and by looking at the pages people are linking to within their Tweets. A Twitter crawler will visit the links, index the page and then correlate that 3rd-party content with the Tweet itself. This should help make for more relevant Twitter search results.

In addition, Twitter hopes to build a ranking algorithm that not only takes into account relevancy, but also the current hot trends and reputation of the Twitter users. Jayaram said he didn’t know yet exactly how the algorithm will work, but it would include some method of user reputation along with the Twitter Trends and relevancy of the Tweets.


Barry Schwartz is Search Engine Land's News Editor and owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry's personal blog is named Cartoon Barry and he can be followed on Twitter here.

See more articles by Barry Schwartz >

Share, Bookmark & Discuss This Article
More:

Keep Updated: News Via Email | News Via RSS Feed | News Via Twitter

See more stories like this in the Members Library! Check out the Top News, Twitter sections of the Members Library where this story is filed. Members also get access to exclusive video content, a members-only weekly & monthly newsletter, plus more. Check out all the benefits!

Comments are closed.

RECENT COMMENTS

  • poiriem said " Excellent article, and yes it is a real problem - especially for agencies - managing budgets and KPI"
  • AdvertiseSpace said " Thank you for sharing, Google maps are very helpful in almost all categories of business. I am glad "
  • AdvertiseSpace said " I am a music person and I hope Google will make this all happen. This will serve as a big threat to "

See All »

FREE DAILY SEARCH NEWS RECAP!

Stay on top of all the search news with our daily summary, the SearchCap newsletter. View a sample ›

STAY CURRENT THROUGHOUT THE DAY

RSS Feeds

The Search Engine Land feed keeps you informed as news happens. SEE ALL FEEDS »

Upcoming Search Engine Land Conferences

Advertise With Us »

Search Engine Land produces SMX, the Search Marketing Expo conference series. SMX events deliver the most comprehensive educational and networking experiences - whether you're just starting in search marketing or you're a seasoned expert.


SMX Web Site » | SMX Difference » | SMX News »


Join us at an upcoming SMX event:

Search Marketing Now Learn more about search marketing with our free online webcasts and webinars from our sister site, Search Marketing Now. Upcoming online events include:


See more webcast topics »

TRACK US SOCIALLY
Upcoming Search Engine Land Conferences

Get Your Search Engine Land
Premium Membership!

Become a premium member today and receive:

  • Express commenting privileges & photo.
  • Exclusive videos & newsletters.
  • Discounts to our SMX conferences.
  • Access to "How To" & Other Archives.

Learn More

Upcoming Search Engine Land Conferences
En Espanol|Contact|Members Info|RSS Feeds|Email Subscriptions|Privacy|Advertise
Add to GoogleAdd to My Yahoo!Add to BloglinesAdd to NetvibesAdd to Windows Live