News for hackers. Stuff that matters.
Re:Hey Twitter: Give us our Tweets by moron4hire on Friday September 24, 2010 @04:20PM (#1725269)
If I whisper the most beautiful poem over the telephone to my lover today, am I going to complain about the phone company not archiving that call properly when I want to revisit it 20 years from now? You go into Twitter knowing it's about the ebb and flow of current conversation, not about what was said when it first came out. If Twitter wants to eventually offer that, that's cool, but that's not the case right now, and you shouldn't expect it any more than you should expect 7-11 to keep their security footage of you for your perusal indefinitely into the future.

edit: from Twitter's Terms of Use (http://twitter.com/tos): "This license is you authorizing us to make your Tweets available to the rest of the world and to let others do the same. But what’s yours is yours – you own your content."

You own your content. You are responsible for it.

Re:Hey Twitter: Give us our Tweets by Legion on Friday September 24, 2010 @05:10PM (#1725439)
While everything you said is correct, at the same time, there's no sense in losing access to data that's recorded and is sitting right there for the taking, if only there were a more convenient way to extract it.

It would be very wise of Twitter to offer a bulk export function - not because they have to, but because it's to Twitter's benefit to not have me thinking twice about whether I should post to Twitter or communicate in some other, more archive-friendly way.

Re:Hey Twitter: Give us our Tweets by moron4hire on Friday September 24, 2010 @05:31PM (#1725510)
From Twitter's perspective, you're absolutely right. From a user's perspective, the bulk reliance on singular companies to manage our data is an issue that I'm afraid is going to become dangerous.

Look at the 2.5 hour Facebook outage from a couple of days ago. If Facebook were to be hit by an airplane or asteroid, a seriously significant portion of 500,000,000 peoples' lives would be lost, if only just in photos. If my house were to have the same thing happen, 150 people would experience a somewhat lesser loss.

I have thousands of emails between close friends in Gmail that I would like to preserve, but no convenient system exists for archiving them away from Google. The point of archive is to have redundant systems on which to rely. Archiving my Gmail with Google is therefore not an archive since it's still only one system.

It's like leaving a tasty pork chop in the 'fridge at work and expecting the cleaning lady to not toss it over the weekend. I really think archive should be the responsibility of the user.

Re:Hey Twitter: Give us our Tweets by pronoiac on Friday September 24, 2010 @07:59PM (#1725854)
I have thousands of emails between close friends in Gmail that I would like to preserve, but no convenient system exists for archiving them away from Google.

How about IMAP?

Re:Hey Twitter: Give us our Tweets by moron4hire on Saturday September 25, 2010 @02:37AM (#1726479)
Tried it, volume is too large. Every client I've tried crashes before it can get everything, and there is still the issue of convenient storage format. I'll probably have to write my own archiver.
Re:Hey Twitter: Give us our Tweets by jaymon on Saturday September 25, 2010 @06:42AM (#1726718)
I wrote this a few years ago to archive my Gmail emails to text files (and the attachments to whatever they are).

I haven't ran it in awhile but when I did it worked and was able to download my emails from the very beginning without crashing. Anyway, you might find it useful...

http://github.com/Jaymon/Popbak

Re:Hey Twitter: Give us our Tweets by svag on Saturday September 25, 2010 @07:00AM (#1726729)
I have been using Zimbra Desktop as an email client, http://www.zimbra.com/products/desktop.html, in my Mac in several GMail accounts with no problem. There are versions for Window and Linux.
Re:Hey Twitter: Give us our Tweets by gwern on Saturday September 25, 2010 @08:45PM (#1728241)
So use getmail_fetch through the POP server; it downloads a few hundred at a time into a maildir format. Hard to get more convenient and storable than that (tar it up and gzip or 7zip it).
Re:Hey Twitter: Give us our Tweets by _delirium on Friday September 24, 2010 @09:38PM (#1726058)
That reminds me of Jason Scott's comments about trusting "the cloud" with your data and not keeping it locally: http://ascii.textfiles.com/archives/1717
Re:Hey Twitter: Give us our Tweets by moron4hire on Saturday September 25, 2010 @02:44AM (#1726485)
That's exactly right
Re:Hey Twitter: Give us our Tweets by holman on Friday September 24, 2010 @05:17PM (#1725468)
I agree, for the most part. But there's some subtleties:

1. Yes, Twitter's real-time just like the phone, but it's not only real-time like the phone. You can revisit any tweet you like. They support viewing old tweets, they support listing old tweets. My only concern is that they place limits on how much they list.

2. Yes, we're responsible for our content, but the significance of services change over time. Tomorrow's Hacker News startup might be interesting, you might drop some content in, but most people aren't going to immediately create an offsite backup. Likewise, the tweets we made in the first two years of Twitter's life probably seemed worthless to us at the time, but now their value has increased. It just would be nice to have access to that.

Re:Hey Twitter: Give us our Tweets by scott_s on Friday September 24, 2010 @06:08PM (#1725613)
They place limits on how much they list for, most likely, technical difficulties with guaranteeing full history access.

This means that if you want a full history of your tweets, then it's your responsibility to maintain it. Would it be a good service to its users if Twitter maintained full history? Yes, but that's not your argument. Your argument is that it's a user's right.

Re:Hey Twitter: Give us our Tweets by moron4hire on Friday September 24, 2010 @05:35PM (#1725522)
Does it make sense to rely on the original provider for archive? As I say in my other reply to the other replier, I really think diversity in archive options is important to the overall infrastructure of the 'Net.