How to Create a Useful Twitter Archive

The amount of information we share daily on Twitter is enormous: nowadays we rely on Twitter for sharing our most important updates, streaming our events and conferences, for collecting testimonials, creating group chats, etc.

We rely on Twitter daily for sharing our most important updates and news.

But do you know how unreliable it really is?

First, Twitter search doesn’t actually keep your shares in its index for a long period of time. Twitter used to officially state that they only search through tweets until they get older than about 10 days (I wasn’t able to find this information in the updated documentation. Now they only state that the archive should not be “too old” to be searchable).

Apart from that wicked search indexing limitation, Twitter also has limits as to your personal Tweets. They currently only allow you to see the 3200 of your recent tweets.

Now, imagine you spent a great deal of time and effort promoting your conference hashtag to then go back in time and find that all those valuable tweets are now gone and there’s no way to write a report or collect some valuable testimonials for your upcoming event. In fact, all those tweets are most likely to still exist but there’s no way to find them!

I personally had to deal with such a problem when we ran a Twitter contest a while ago where to participate one needed to Tweet something using the unique hashtag. In a bit over than a week, none of those Tweets was to be found in Twitter search and I had to use Google to select the winner (don’t judge, I was stupid, I know that now).

That being said, this post will show you how to archive Tweets based on various criteria for you to:

  • Be able to refer to them later (even in a year or two);
  • Enjoy more search options to search through your archives;
  • Republish your archives later easily.

1. Google Reader

Any Twitter Search generates an atom feed link that can be used to subscribe to it via your preferred RSS reader. Why Google Reader is preferred in this case?

It’s because Google Reader will archive all the read and unread items starting from the day you subscribed. This makes your archive of Tweets searchable and pretty much ageless (if you don’t expect Google to be destroyed in the nearest future).

So, step 1: Search Twitter:

Twitter archive

Step 2: Use the atom link to subscribe to it in Google Reader:

Twitter archive

Step 3: Search the Archive any time!

Search twitter archive

2. TwapperKeeper

I have already mentioned this tool in my post on how event organizers should take advantage of Twitter to help participants connect and keep everyone updated (even those people who couldn’t make it to the event). The tool turned really useful and we even used it internally and were very much impressed by the options (despite the pretty much simplistic interface).

TwapperKeeper is a handy tool that allows to create the permanent archive of all Tweets around any hashtag. With help of this tool, you can create a one-reference source of knowledge exchange around any event.

To create an event, first login with your Twitter account (using Twitter authentication) and then simply provide the hashtag, description and tags:

TwapperKeeper

The best thing about the tool is its great filtering options. Any archive can be sorted by date, filtered by user or a keyword and set to exclude all the Retweets. No matter which sorting and filtering options you choose, you will be able to get the direct URL of the new archive to link to.

Moreover, you can also export your archive to save it locally as an Excel file (which means even more filters and formatting options!). I suggest you do it after your event is over by the way because storing them externally is still risky.

Another great tool that saves any Twitter hashtag archive locally is The Archivist

3. Self-Hosted WordPress Blog

There are a few options to export and archive all your tweets to WordPress (to either share them further with the world or just keep your archive to yourself). The benefits of doing so are obvious:

  • You have the full control of what you share: you don’t have to rely on any third-party service in hosting your updates;
  • You get the up-to-date searchable archive of your Tweets (backed-up regularly which most hosting services do by default).
  • You get the power to save and search your Tweets without any limits.

One of the newest and best options is Ozh’ Tweet Archiver WordPress plugin that enables you to create a cool, branded archive of your Tweets on a separate blog. It only takes you a few seconds to install and run and the output is really impressive:

  • Set the update interval;
  • (Un)link usernames and hashtags
  • Create tags out of your hashtags to better organize and visualize your Tweets:

Twitter archive WordPress

Have I inspired you to create a Twitter archive?

For more useful social media content, tips and inspiration, join us on Facebook and follow us on Twitter!

  • Get unfiltered SEO info from Greg Boser, cutting-edge marketing and PR tips from Chris Winfield, and so much more from the rest of the BlueGlass team.
  • The insider perspective on the latest Internet Marketing news.
  • Get deep discounts and other cool goodies for the best software, tools, websites and conferences out there.
  • Be the first to know about BlueGlass conferences, meetups, and surprise releases.
  • Learn what the hottest new tools, plugins, & extensions are as our team delivers three to you each time!
  • Oh yea, this is all FREE!

Comments

  1. OMG I didn’t know about the WP plugin, so awesome. Something else added to my to-do list. Thanks!

  2. Bronson says:

    I have been doing something similar on my blog using LifeStream and it’s daily post feature which works well, albeit a little resource heavy – it’s very handy for Googling old links and posts I’ve interacted with long after the fact.

    The Ozh’ Tweet Archiver WordPress plugin looks like a great alternative that’s a little less resource heavy.

    • Ann Smarty says:

      Is LifeStream still working for you? It stopped working for Twitter with me and I am not sure if I am missing the way to update it or something…

  3. Bill Brown says:
  4. I’ve been using the free version of RowFeeder.com… pretty sick. it puts all the results in a google spreadsheet… That’s cool… currently it works great for me for WordCamp Phoenix but when the actual event comes around I’ll burn through those 500 free ones pretty fast.

  5. Couple more ways:

    Use backupify.com or backupmytweets.com/
    Use tweetbook.in to get a printed book of all your tweets/favorited tweets

    • Ann Smarty says:

      Those I am aware of as well – but I am not sure of the archives can be customized there, can they? They archive pretty much everything but there’s no way to archive hashtag search, right?

  6. B. Moore says:

    New serivce I came across this week:
    GTweet ~ Read Twitter in Google Reader ~ http://gtweetapp.appspot.com/
    Works great so far!

    If all you want is just links from your twitter feed try this service:
    SiftLinks ~ monitors your friend stream on Twitter, pulls out the links and creates an RSS feed
    http://siftlinks.com/

  7. Jeff Watson says:

    I’ve been using the Syndication plugin, AKA FeedWordPress, to store my tweets as posts on a WordPress blog. I’ve also written a little function script to convert the tweets to a custom post type. Would work great for hashtags too, though customization and setup can be a little finicky. That said, it’s been working fine for me for about a year now.

  8. hasson says:

    Or, you could just use HAshable!

  9. Is there a way to archive your older tweets and not just recent ones with Google reader?

    • Ann Smarty says:

      You can only archive Tweets that will be published after you subscribe to RSS, unless I am missing the point.

    • Mohan Arun L says:

      I have written a script that will make a text file out of the last 3200 tweets of any twitter user- the only input required is the twitter id. Anyone who wants the script (free) or for those unable to run scripts, a text file dump of the last 3200 tweets of a particular user (free) should email me here: marun2 [at] gmail [d0t com].

  10. Rahul Batra says:

    This post is really good and specially the information about the new word press plug-in great. Twitter has always helped in generating traffic to the website.

  11. Rina Wallace says:

    If you’ve been using TweetDeck or another Twitter service that uses bit.ly links, then here’s a great tip:

    Go through your timeline and pull out bit.ly links, paste them into your browser, and add a “+” on the end.

    This will automatically send you to the bit.ly statistics page for that link, which gives you conversation
    history, clicks and regional analysis.

    Not only is this a great way to yank out and measure the effectiveness of your tweet history, but it also gives you the opportunity to analyze your competitors!

    Want to know how well someone else’s tweets are faring? Pull out the “+” and you’re in business.

    http://outtoown.com/2010/10/14/3-ways-twitter-analysis-can-enhance-your-marketing/

Trackbacks

  1. Online Marketing Smarts Weekly Mashup…

    This week’s online marketing mashup includes our top picks for resources you can actually use including non-SEO tactics that make you a better SEO, how to build a useful Twitter archive and much  more. 7 Non-SEO Tactics That Will Make You a Bette…