• http://www.gamerstube.com Joe Youngblood

    it makes sense to me. why pay if no one else is? seems like a bad model on twitters part. of course they want google to pay because google is also trying to compete in their market (google+) why help out a competitor?

  • http://www.michael-martinez.com/ Michael Martinez

    I miss the realtime search results because they were a good indicator of how “hot” a topic might be.

    Google could still allow the Tweets to have a direct impact on its search results by arbitrarily disregarding the nofollows on Twitter accounts it was allowing to pass value before. I believe you have reported in the past that only SOME Twitter accounts were actually allowed to pass value.

    Google should have a historical record of which accounts those were and they could construct a seed set or maybe even a training set for a Panda-like algorithm to find and vet new Twitter accounts.

    As many SEOs have been quick to point out, there is no law requiring Google to actually honor the “nofollow” attribute. Google made up that rule and Google could certainly work around it.

    This may be a situation where it would make sense for Google to figure out something.

    Meanwhile, people can look for alternative methods to surface their Tweets and help them pass value.

    Google may have just created a whole new class/generation of Tweet spam. “Welcome to the Caribbean, love!”

  • http://postpo.st PostPost

    Hi Danny. Great summary of the state of Twitter search.

    We also love Topsy but want to clarify that it’s not “the only Twitter archive search service left standing”—PostPo.st is still standing. Today, we go back 3200 Tweets for PostPo.st users and 400 for the people they follow (if they’re not PostPo.st users).

    We’re at the tail end of our beta, so it’s no fault of yours that you don’t know about us: we’re the search engine that returns historical Tweets from you and the people you follow on Twitter.

    As for the merits of a searchable Twitter archive, it’s amazing how engaging the content is when you’re searching through and filtering by the people you follow, and the types of content they share.

    Here’s an example, rich with links and photos:
    http://postpo.st/bradnoble/search?q=endeavour

    You’re welcome to give us a try.

  • http://paulgailey.com Paul Gailey

    No mention of the commendable Backtype service that Twitter acquired this week?

    Another alternative (moreso for the enterprise/brand marketer is the powerful DataSift for Twitter firehose querying and search)

  • http://www.shonmckee.com Shon McKee

    I was wondering what happened to that. I used it quite a bit.

    Topsy is cool but IceRocket is really good. It searches not only Twitter, but blogs and Facebook.

  • http://www.infodocket.com/feed/ gary price

    Hello Everyone, Gary Price here.

    I’m a Contributing Editor that recently joined the SEL team.

    I plan to do a blog post about a few Twitter archiving databases and tools in the next week. I will take a look at the resources you’ve mentioned in the comments and a couple of others. I would love to learn about others.

    Here’s a quick look at two resources I will take a look at.

    1. SnapBird
    http://snapbird.org/

    This search tool allows users to search by keyword using a specific Twitter handle. You can also search for DM’s that you sent and received along with tweets and favorites of your friends.

    I’ve only used SnapBird for a short time and I’ve encountered a few glitches. However, when it worked it I was able to find what I was looking for.

    The oldest tweet I found in my searching was from October, 2009.

    2. TwapperKeeper (TK)
    http://twapperkeeper.com

    The service is free (they also offer extras for a fee) and has been around for a few years. I use it regularly and it’s great. This is the place to go if you want to create an archive of tweets using your handle, a keyword, or a hashtag.

    All archives are public and you can search for them from a link on the TwapperKeeper.com home page. At this time you can access and search more than 25K archives containing more than 3 Billion archived tweets.

    Here’s a searchable archive of every tweet (more than 85,000) using the hashtag #smx back to March, 2010.
    http://twapperkeeper.com/hashtag/smx

    Learn more about the TK fee-based service here: http://twapperkeeper.com/premium.php

    You can download the software and create archives on your own servers.
    http://your.twapperkeeper.com/

  • http://irwebreport.com IRW

    Google real-time search email alerts are another casualty of this. Not sure how much people used real-time alerts, but they were amazingly fast for monitoring brand mentions and other high value topics..

  • Joe Russ Bowman

    While I have no plans to implement a real time streaming search (and will do a blog post later to explain why), my still in heavy development search site http://www.unscatter.com integrates with Topsy as well as other search engines like Blekko. Topsy results are featured on default search queries and the search engine also includes support for Blekko slashtags plus some custom ones I’ve written such as /twitter and /facebook

    I plan on much deeper integration with Topsy in the future, after I finish some back end and front end work to better implement caching.

  • http://postpo.st P.P.

    @ IRW check out @twilert at http://twilert.com – they do what Google RealTime email alerts used to do.

  • http://www.postlinearity.com gregorylent

    i want all my tweets .. i will pay for it .. the learning curve and the record is worth it ..

    how can i do that?

  • http://klout.com/#/jdrch Judah Richardson

    Nicely done, this is the best writeup of this issue I’ve read so far

  • http://niute.ch N.T.

    Why have you mentioned Topsy and haven’t mentioned WhosTalkin or Socialmention or other real-time search engines

  • http://www.pagerank-seo.com Robert Visser

    One of the great losses with the expiration of the agreement w/ Twitter & while Google Realtime is revamped are the links to breaking news.

    What I’ve found substantially less useful since Google Realtime was removed last Sat. is checking the Google Alerts for both my clients and my own business. Many of these alerts were set-up specifically to check mentions & links for keywords & profile names. The absence of these goes beyond just Twitter. It includes sites with which Twitter cross fed Timelines/content. These include Friendfeed, Identi, Plurk, Pixelpipe, etc.

    While I wouldn’t want to speculate on whether Google would have attributed anything near the boost we received in the SERPs from Twitter to any of these other social media services, that they’re now absent (or at least diminished) from Google Alerts potentially has broader impacts. CRM & online reputation monitoring, etc.

    We’ll have to see what’s reintroduced & how Google+ will be integrated. I’m disillusioned with the algorithm the Google+ team is running on Sparks. In my opinion it needs a serious jolt of caffeine in the form of integrating Realtime results.

    I was pleased to see the addition of Social Plugin Tracking in Google Analytics http://goo.gl/CYruJ .

  • Darryl Lee

    As always, thanks for the great reporting, Danny. I’m a long-time reader.

    As an end-user I could care less about real-time results in Google, especially since most of those results are available on Twitter itself.

    But I’ve been hating Twitter’s lack of historical search for a long time now. Topsy is pretty good, but I suspect they’re only indexing people with a minimum number of followers. Because I can’t find my old posts. Same thing for snapbird, twapperkeeper, and postpo.st. Which is fine. I don’t expect a third-party to waste resources archiving all the times I’ve tweeted trying to win an iPad2. But I do expect that Twitter itself ought to make it easier to search a very finite number of tweets, since I’m limiting it to just my username.

    @gregorylent, all your posts are at http://twitter.com/#!/gregorylent (assuming that’s you), but I suspect that you really mean you’d pay to have them be searchable beyond 1 day. I hear you man, I hear you. But apparently nobody else cares about looking back, just what’s happening now now now.

  • http://postpo.st P.P.

    @Darryl Lee,

    Have you searched PostPo.st for “ipad 2″? I think you’ll be amazed what you find.

    Please let us know on Twitter @postposting.

  • Darryl Lee

    Thanks @postposting — can I just call you PoPo? I loaded myself up, and it’s nice, but it doesn’t find this one: http://twitter.com/#!/notyoutoo/statuses/5901613258

  • http://www.sergiozaragoza.com SergioZaragoza

    Great article. The worst part is the shutting down of Google Real Time Alerts on google alerts system. This emailed me real time buzz search results on my customers names and products. either with ther @account or just the name… thats the worst part.. any other solution for that??