On 23 December I received an email which confirmed the news about the forthcoming demise of the Twapper Keeper Twitter archiving service:

First off, on January 6th 2012, the TwapperKeeper.com site, and all related archives, will be shutdown with no access to any existing archives. Please ensure you have compiled all of your data by this date.

What should you do if you wish to continue keeping an archive of tweets, especially for event-related tweets which seems to be one particularly valuable use case?

One solution is to use Twapper Keeper! Or perhaps I should say Your Twapper Keeper, the open source version of Twapper Keeper. As part of the developments to the Twapper Keeper service the software was made available under an open source software licence in order to decouple the provision of the service from the software used to provide the service. Anyone, therefore is free to download the software from the Github repository and set up their own Twitter archive.

For those who have warned about the risks of dependencies on third party services for which there are no formal contractual agreements this example perhaps demonstrates the value of funding the development of an open source alternative. But is this really the case? Will institutions be downloading the software in order to be able to manage their own archives? I see no evidence that this is having, but I’d like to be proved wrong.

Perhaps this is a case for which an easy-to-use proprietary solution is all that is needed, especially since the content is typically not created primarily be members of a specific institution but, in the case of event-related Twitter archives, attendees at an event who are likely to be based across the sector rather than at a single institution.

On the Event Amplifier blog in a post entitled Goodbye Twapper Keeper Kirsty Pitkin explores the possibility of using Hoot Suite, the company which purchased Twapper Keeper, for managing Twitter archives. However Kirsty has described the financial implications of such a decision:

A Pro customer (paying $5.99 per month) can archive only a measly 100 tweets, or purchase a bolt on to archive up to “100,000 tweets and download all keyword related Twitter messages”. When I attempted to upgrade my plan, I found that 10,000 additional tweets would cost me $10 per month, and 100,000 additional tweets would cost me $50 per month.

But in addition to the options of installing the Your Twapper Keeper software or purchasing an appropriate account from HootSuite, Kirsty has highlighted an alternative approach: “Martin Hawksey is a master of Google Spreadsheet tools and has created this alternative method of collecting tweets and has provided detailed instructions to archive and visualise Twitter conversations around an event hashtag“.

Martin has helpfully provided a video which is available on YouTube and embedded below which describes how to use his solution.


It will be interesting to see which, if any, of these options proves the most popular solution across the sector: the open source solution, the subscription service, the Google solution or possibly an approach I haven’t described. Which will you be choosing?

Twitter conversation from Topsy: [View]