News for hackers. Stuff that matters.
Re:Gmvault: gmail backup. Liberate your emails by pilif on Monday May 07, 2012 @11:19AM (#3939339)
if your tagline is "For geek and non-geek users." then you probably should not be depending on users to open a shell and type commands there to access their emails.

For this to be remotely useful for non-geeks, try adding a small IMAP server so people can access the mails through their mail clients. Having to re-upload all mail back to a (presumably new) gmail account will take ages and accessing the mails locally is not really helpful these days with mime encoding and HTML email.

On a related note: If you have a small box with a PTR record laying around somewhere, you can use my setup described at http://pilif.github.com/2011/02/how-i-back-up-gmail/ to route all incoming and outgoing mail through a mail server you own as it moves to and from gmail.

If you ever lose your google account or its data, all mails will be on your small box in convenient maildir format, ready to be served over IMAP.

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @11:33AM (#3939405)
Thanks for the comment. Yeah the "for geek and non-geek" is a bit premature. I would like to create a gui for the tool that will be for non geek. Regarding your second points, currently Gmvault is a tool to backup your Gmail account and restore it into a Gmail account preserving labels and unread emails, etc. The Gmail web interface I think is the premiere interface for Gmail and with Gmvault, I want to offer to users a "safety belt for Gmail" (backup and incremental backup) and allow them to restore all your emails as they were in the Gmail web interface.
Re:Gmvault: gmail backup. Liberate your emails by v0cab on Tuesday May 08, 2012 @06:28AM (#3943003)
I really hate being called a geek. I associate it with bullying and social exclusion. It may be OK to be a geek in Silicon Valley, but that's not true everywhere.

If you bring that line back, please replace it with 'For techies and non-techies' or similar.

Re:Gmvault: gmail backup. Liberate your emails by kijin on Monday May 07, 2012 @01:45PM (#3940071)
> try adding a small IMAP server so people can access the mails through their mail clients. Having to re-upload all mail back to a (presumably new) gmail account will take ages and accessing the mails locally is not really helpful these days with mime encoding and HTML email.

One of the stated purposes of this tool is to "liberate your emails" by letting you keep local copies of every e-mail you send and receive. If you need to use a third-party IMAP server to keep a backup of your e-mails, how does that liberate you? Now you're dependent on two online services instead of one.

Reading locally stored e-mails would be a problem for non-geeks, though. But I think the right way to solve that problem would be to offer a program to read those e-mails, or even better, a plugin to a popular mail client (such as Thunderbird) so that the e-mails can be accessed through the mail client. Depending on the "cloud" just detracts from the stated purpose of this tool.

Re:Gmvault: gmail backup. Liberate your emails by pilif on Monday May 07, 2012 @01:54PM (#3940105)
I wasn't talking about a third party IMAP server. I was talking about adding an IMAP darmon right in the backup application itself.

That way, if your google account goes away (I guess we all agree that administrative account lockout is way more likely than google actually losing data) and you need an email RIGHT NOW, you would just configure any imap client to use the daemon provided by the backup application (localhost:143)

Or it could bundle some web based mail client and then open a browser.

It's impractical to reupload the whole backup to gmail before being able to access your mail.

Re:Gmvault: gmail backup. Liberate your emails by kijin on Monday May 07, 2012 @02:31PM (#3940271)
Thanks for the clarification, it seems that I misunderstood your comment. A local IMAP server would fit right into my suggestion of mail client integration, without the headache of writing a plugin.

But now you've got a background process running on a privileged port, yikes! (It's got to be a daemon that starts automatically, because "non-geeks" will not understand why they have to start another program before accessing their mail in Thunderbird.)

Re:Gmvault: gmail backup. Liberate your emails by EwanG on Monday May 07, 2012 @10:12PM (#3941879)
Better option (IMNSHO), if someone wants to read the email they don't REALLY care if it's as an email. So a reader application that parses the DL'd file so that you can do rudimentary search, find what you want, and then copy/paste as necessary.
Re:Gmvault: gmail backup. Liberate your emails by pilif on Monday May 07, 2012 @02:42PM (#3940350)
You could still be running on an unprivileged port and bundle a preconfigured thunderbird. Or you run on an unprivileged port and bundle some webmail solution (the localhost:143 was just for illustration)
Re:Gmvault: gmail backup. Liberate your emails by callahad on Monday May 07, 2012 @01:56PM (#3940110)
> Now you're dependent on two online services instead of one.

I think you're misunderstanding pilif's comment. That "small IMAP server" would run locally on your box, which gets you to the goal of having any standard mail client read the archive.

Re:Gmvault: gmail backup. Liberate your emails by digitalsushi on Monday May 07, 2012 @12:28PM (#3939676)
Just a few weeks ago I was looking for exactly this piece of software! What brilliant timing.

But a quick question of concern - gmail is pretty smart and can tell when I am just using it for bulk storage. If you send yourself 8 emails in a short amount of time, each with maximum sized attachment sizes, gmail will politely tell you to cut it out for a while.

Does this software run the same risk? I am wary to let it just keep barging in after connection errors, if there's a chance gmail will get upset and ban me from my own account. My gmail is my lifeblood, and I want to back it up from the entity that scares me the most of taking it away from me.

Thanks for making this!!

Re:Gmvault: gmail backup. Liberate your emails by justincormack on Monday May 07, 2012 @12:57PM (#3939828)
It should be no different from what would happen if you connect a new imap program that does a full sync of your mailbox, which many do.
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @03:18PM (#3940519)
Well so far I've been doing many download and upload of my entire mailbox (5 GB) and the Gmail team did not contact me to tell me to slow down a bit. Sometimes (especially during the week-end ?) the connection was cut and I could had to wait to finish to restore my gmail account.
Re:Gmvault: gmail backup. Liberate your emails by utexaspunk on Monday May 07, 2012 @11:12AM (#3939296)
Sweet! I'm gonna keep my gmail backup on my google drive!
Re:Gmvault: gmail backup. Liberate your emails by amouat on Monday May 07, 2012 @11:20AM (#3939341)
Err, isn't there a flaw in that plan?

Surely the back-up should protect you in case you lose access to your Google account...

Re:Gmvault: gmail backup. Liberate your emails by camiller on Monday May 07, 2012 @11:26AM (#3939366)
I think he was trying to be subtly ironic. Perhaps too subtle.
Re:Gmvault: gmail backup. Liberate your emails by amouat on Monday May 07, 2012 @12:05PM (#3939552)
I wondered that after I wrote the reply.

However, I bet some people do use google drive to back-up other google services. It's not ironic, just foolish IMO.

Re:Gmvault: gmail backup. Liberate your emails by icebraining on Monday May 07, 2012 @02:53PM (#3940406)
You can always create different Google accounts for each service. My "main" account (Reader, Youtube, etc) was never tied to my Gmail & Calendar account, and the probability of losing both at the same time is rather small.
Re:Gmvault: gmail backup. Liberate your emails by mcherm on Monday May 07, 2012 @05:19PM (#3941015)
Not as small as you may think. Do you really believe that Google can't connect the dots (or the IP addresses) and figure out that both accounts are associated with the same person?
Re:Gmvault: gmail backup. Liberate your emails by skeletonjelly on Monday May 07, 2012 @08:54PM (#3941680)
They'd have to tread carefully. Would suck to have an entire university banned from Google services ;)
Re:Gmvault: gmail backup. Liberate your emails by mcherm on Wednesday May 09, 2012 @09:34AM (#3948440)
True... but I imagine they can also distinguish between frequently-shared IPs and rarely-shared ones.
Re:Gmvault: gmail backup. Liberate your emails by DanBlake on Monday May 07, 2012 @11:07AM (#3939283)
Great tool, awesome work. Gmail should really offer a link to backup your mail though. I know you can do it with mail clients and this, but its annoying I cant just download one big zip file from gmail itself.
Re:Gmvault: gmail backup. Liberate your emails by jemfinch on Monday May 07, 2012 @11:11AM (#3939295)
I imagine (and I'm not speaking for my employer here) that it has to do with cost: if the easiest way to backup your email is by using IMAP or POP, it's essentially an incremental backup mechanism. If the easiest way to backup your email is by clicking a link which contains all your email in a .zip file, it would be a non-incremental backup system and its cost would be much higher, because people would be far more likely to repeatedly download the same emails.
Re:Gmvault: gmail backup. Liberate your emails by DanBlake on Monday May 07, 2012 @11:26AM (#3939364)
Maybe there could be a few options? Download all mail, download by month, download by year? Seems like they could solve that problem pretty easily and would be very awesome.
Re:Gmvault: gmail backup. Liberate your emails by jemfinch on Monday May 07, 2012 @12:08PM (#3939568)
Offering different zipfiles for months/years wouldn't solve the problem. "The problem" is that when you have hundreds of millions of users, the easiest mechanism needs to be an efficient mechanism. Adding links for months/years would still leave the easiest mechanism as the least efficient: I know that I, personally, would continue to download the "all mail" zipfile just to ensure that I didn't miss anything. I cannot imagine my mother or grandmother doing anything different.
Re:Gmvault: gmail backup. Liberate your emails by kristiandupont on Monday May 07, 2012 @11:36AM (#3939424)
I don't think it would. That would then be something I would have to set up reminders for and then what if I forget it for a few days? I would have to remember when I last backed up and set that as the starting date. Of course google could remember that for me but we're now getting closer and closer to what IMAP already does better.
Re:Gmvault: gmail backup. Liberate your emails by chimeracoder on Monday May 07, 2012 @12:36PM (#3939719)
When I first set up offlineimap, it downloaded my entire account history on the first day - I'm not sure how that would be less expensive than a single zip file to download on that same day too.
Re:Gmvault: gmail backup. Liberate your emails by cytzol on Monday May 07, 2012 @12:43PM (#3939768)
I imagine that most people would download their entire e-mail history, stick with what they know, and re-download their entire history week after week.
Re:Gmvault: gmail backup. Liberate your emails by chimeracoder on Monday May 07, 2012 @02:50PM (#3940398)
Sure, but it would be easy to wrap that inside a Google 'download my data' tool' only downloaded the diff of all your data (not just email) and provided that in compressed form.

I'd prefer the direct zip, sure, but I'm just saying that it's not inconceivable.

Re:Gmvault: gmail backup. Liberate your emails by amirmc on Monday May 07, 2012 @06:42PM (#3941300)
You can argue that's it not technically inconcievable but if anyone were to implement it this way, it would likely become a nightmare of usability and broken expectations.

If I'm 'downloading' or otherwise 'exporting' data from any service, I expect it to be all the data. Not a diff wrt the last time I clicked the button.

Re:Gmvault: gmail backup. Liberate your emails by sp332 on Monday May 07, 2012 @11:14AM (#3939312)
I don't really see the advantage to that? Do you just prefer HTTP to IMAP? :)
Re:Gmvault: gmail backup. Liberate your emails by DanBlake on Monday May 07, 2012 @11:25AM (#3939357)
Its ease of use and ease of storage. Setting up a mail client and getting it to download everything isnt a 1 click operation.

However, clicking "download backup now" is a very easy 1 click operation, and I can just store that zip file wherever I want. Done.

Re:Gmvault: gmail backup. Liberate your emails by amirmc on Monday May 07, 2012 @11:36AM (#3939423)
Backups are only as useful as the 'restore' strategy. If I had a zip of all my email somewhere I wouldn't really know what to do with it (and it'd be obsolete pretty quickly).

I mainly use Gmail via IMAP (and the web version when I need to set up filters). Therefore, I'm intrigued that folks seem to be interested in a 1-click-download kind of solution.

Re:Gmvault: gmail backup. Liberate your emails by sp332 on Monday May 07, 2012 @11:31AM (#3939396)
I guess installing an email client is a hassle. But in Outlook and Thunderbird (at least), it really is that easy. You just put in your email address and password and it will start downloading automatically.
Re:Gmvault: gmail backup. Liberate your emails by espinchi on Monday May 07, 2012 @11:10AM (#3939292)
I hope they'll eventually do this too. They have this *Data Liberation Front" (http://www.dataliberation.org/), from where you can already download some data in simple zip files.
Re:Gmvault: gmail backup. Liberate your emails by Drbble on Wednesday May 09, 2012 @12:03AM (#3947056)
Bizarre that you can download aggs of docsr and phoos-- and photos don't compress! But not a few hunded megs of zipped mail. www.google.com/takeout
Re:Gmvault: gmail backup. Liberate your emails by muyuu on Tuesday May 08, 2012 @06:13AM (#3942971)
This would be hard to implement effectively. HTTP sucks for downloading massive files.
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Tuesday May 08, 2012 @07:59AM (#3943188)
Thank you all for the feedback and support. It's been great and proved that a simple tool up for that task is needed by plenty of people.

If you would like to participate and help me developing Gmvault contact me on twitter at @zoobert or via email: guillaume((dot))aubert((at))gmail((dot))com

I will now work hard to finalize Gmvault and produce the first final release (available within a month).

If you would like to report some issues or would like extra features: submit them to https://github.com/gaubert/gmvault/issues

Re:Gmvault: gmail backup. Liberate your emails by kozubik on Monday May 07, 2012 @03:29PM (#3940569)
No promises, but I think we will enable this on rsync.net storage arrays...

We already have s3cmd in our environment, so you can:

ssh [email protected] s3cmd get s3://rsynctest/mscdex.exe

So if we put this into the environment, you could call it over SSH:

ssh [email protected] gmvault sync [email protected]

... which is fantastic.

More like this.

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @04:53PM (#3940925)
Awesome. Let me know if you need some support.
Re:Gmvault: gmail backup. Liberate your emails by toomuchtodo on Tuesday May 08, 2012 @07:21PM (#3946313)
Any chance you could build S3 support into Gmvault? So you could cron it on a linux box to connect to Google and push all the data into an S3 bucket? If money is an issue, I'd be interested in footing the bill.
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Wednesday May 09, 2012 @09:39AM (#3948468)
This is something I have in mind: Cloud save. It will be added in the roadmap. Please contact me and I will keep you in the loop. Regarding the money I am thinking of adding a donate button to support the project.
Re:Gmvault: gmail backup. Liberate your emails by rcthompson on Monday May 07, 2012 @02:07PM (#3940168)
Small nitpick: the application name "Gmvault" is inconsistent with the tagline "Liberate your emails", since one does not normally associate vaults with liberation. Maybe something like "protect your email" would be more vault-appropriate?
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @03:12PM (#3940494)
;-) I like that. Thanks for helping me keeping the theme right
Re:Gmvault: gmail backup. Liberate your emails by rcthompson on Monday May 07, 2012 @08:01PM (#3941521)
Also, don't go with exactly "Protect your email", since it sounds kind of bland. Just something like that. Maybe "Safeguard your email". Find an exciting synonym for "protect"!
Re:Gmvault: gmail backup. Liberate your emails by minikomi on Monday May 07, 2012 @08:12PM (#3941553)
Or maybe "Stash your mail"
Re:Gmvault: gmail backup. Liberate your emails by dools on Monday May 07, 2012 @08:00PM (#3941515)
I just use fetchmail to grab everything (except spam) from gmail anyway but this:

"With the restore command Gmvault can recreate your gmail mailboxes in any Gmail account. All attributes such as Gmail labels are preserved and recreated. With restore, you will recover your Gmail account exactly as it was."

I would use it just for that! When I wanted to unify my email/calendar etc. under one account there didn't seem to be anyway of transporting existing gmail over. Gmail doesn't even have a way to do it if you decide to start paying them!!

Re:Gmvault: gmail backup. Liberate your emails by mikemarotti on Monday May 07, 2012 @11:12AM (#3939298)
Granted this isn't working for me to begin with (http://i.imgur.com/yLzyy.png), but will this tool work to archive Google Apps email accounts? eg. Gmail accounts that do not end in gmail.com?
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @02:08PM (#3940169)
At the beginning of the bash script gmvault there is a variable called GMVAULT_HOME. If instead of .. you had the full path to the gmvault-v1.0-beta dir that should work. If there are more problem could you please run it like this: $>sh -x ./gmvault sync .... and send me the console print.

I will fix that in the next version. Thanks for the feedback

Re:Gmvault: gmail backup. Liberate your emails by mikemarotti on Monday May 07, 2012 @02:43PM (#3940359)
Still not working for me, I will send you an email. Thank you for working on this tool though - our company would gladly pay for an enterprise version of this (especially if it was a bit more seamless and integrated with Google Apps somehow).
Re:Gmvault: gmail backup. Liberate your emails by weiran on Monday May 07, 2012 @11:56AM (#3939517)
It's working on my Apps account.
Re:Gmvault: gmail backup. Liberate your emails by gglanzani on Monday May 07, 2012 @01:26PM (#3939966)
Also with mine.
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @03:22PM (#3940533)
please gglanzani and weiran. Send me your errors or create an issue in https://github.com/gaubert/gmvault/issues I would appreciate to have the logs with the debug activated: ./gmvault sync [email protected] --debug
Re:Gmvault: gmail backup. Liberate your emails by boreacrat on Monday May 07, 2012 @09:24PM (#3941738)
they said it _is_ working for them:)
Re:Gmvault: gmail backup. Liberate your emails by carterschonwald on Monday May 07, 2012 @05:05PM (#3940976)
Hey: I"m trying it out, and its not entirely clear if its properly incremental. To whit, if I halt it mid backup and start it up again, it seems to start from scratch all over again.

am I miss interpreting how its working?

Re:Gmvault: gmail backup. Liberate your emails by michaelmior on Monday May 07, 2012 @01:29PM (#3939988)
For anyone trying to get the Linux version to work, here's what worked for me.

1. Download the tgz and unzip.

2. Create and activate a new virtualenv in that directory.

3. easy_install -U distribute (in my case, the version of distribute installed by pip was too old for imapclient)

3. pip install logbook gdata imapclient

4. Replace bin/gmvault with the following

    #!/usr/bin/env python
    import sys
    import os
    
    sys.path.insert(0, os.path.abspath(os.path.join(sys.path[0], '../lib')))
    
    import gmv.gmv_cmd as runner
    runner.bootstrap_run()
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @01:36PM (#3940032)
the release on HackerNews is a bit premature. I wanted to test the response and was not expecting so much interest. I will fix the deployment issues on Linux and Mac OS X. You can download the tgz and run a michael said.

You can also use easy_install or pip. It is on Pypi Create a virtualenv as it is better and do: pip install gmvault (or easy_install gmvault)

See http://gmvault.org/install.html#py_install for further info

Re:Gmvault: gmail backup. Liberate your emails by samuel1604 on Monday May 07, 2012 @10:39AM (#3939159)
wha's the difference between this and a tool like offlineimap?
Re:Gmvault: gmail backup. Liberate your emails by callahad on Monday May 07, 2012 @11:06AM (#3939276)
As an OfflineIMAP user, I see a few immediate differences:

1. OfflineIMAP expects standard IMAP servers. GMVault has special casing to handle Google's wonky IMAP support, along with features like labels and the "All Mail" directory.

2. OfflineIMAP is GPLv2 (or 3, at your option). GMVault is GPLv3.

3. OfflineIMAP syncs to either a local Maildir or another IMAP server. GMVault syncs to its own custom on-disk representation.

4. OfflineIMAP uses a username/password to log in to servers. GMVault uses XOAuth.

5. OfflineIMAP is fully bi-directional by default; local deletion propagates to the remote server. GMVault notes that "manually deleting emails or emails' directories does not prevent Gmvault from working."

6. GMVault can encrypt its own archives. OfflineIMAP cannot.

Basically, GMVault looks like a much less general-purpose tool, but in its specialization, should allow for a much nicer experience for users that simply want a backup for their GMail account.

I'm fond of the versatility that OfflineIMAP gives me (I can restore my mail to any IMAP server, not just GMail; I can access the local Maildir with other applications like Dovecot and Mutt; etc.), but excited about the possibilities of GMVault for friends and family.

"Do you have your GMail backed up? No? Here, let me install GMVault for you..."

Re:Gmvault: gmail backup. Liberate your emails by emillon on Monday May 07, 2012 @11:29AM (#3939384)
I believe that OfflineIMAP now has gmail-specific code (type = Gmail) :

http://docs.offlineimap.org/en/latest/MANUAL.html#sync-from-...

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @02:17PM (#3940206)
it is only to backup specific target labels (or imap directories). If you ever restore your Gmail account with OfflineIMAP then I think that you will loose partly this information. I would say the purpose of these tools is different.
Re:Gmvault: gmail backup. Liberate your emails by bob87 on Monday May 07, 2012 @12:16PM (#3939620)
How do you get it to encrypt its own archives?
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @03:19PM (#3940522)
You use the --encrypt flag. See ./gmvault sync -h for more info
Re:Gmvault: gmail backup. Liberate your emails by rickmb on Monday May 07, 2012 @11:06AM (#3939273)
Apparently, it also backs up Gmail specific stuff like labels. Which is nice, but if Gmail every bites you in the ass so hard that this is the only way to recover, would you trust Gmail again?

As for myself, I just imap my Gmail accounts and don't use those features exactly to avoid that kind of lock-in. I've used too many email services and clients in my lifetime to assume Google is the final solution. And safeguarding my mail offline with imap works just fine.

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @11:02AM (#3939252)
Gmvault is a tool entirely dedicated to Gmail so it will recreate your account exactly as it was. Standard imap backuping tool like OfflineIMAP do not preserve labels when restoring emails on an imap server because your have to use a Gmail specific extension. For example it will take care of the Gmail labels and will recreate them when restoring the emails on an account. More features are available. Check the documentation.
Re:Gmvault: gmail backup. Liberate your emails by pyre on Monday May 07, 2012 @12:12PM (#3939593)
Hopefully it flakes out/dies less often than offlineimap.
Re:Gmvault: gmail backup. Liberate your emails by afterburner on Monday May 07, 2012 @11:24AM (#3939356)
I used another Gmail backup tool once that made all my emails "read". Does this do that too?
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @11:37AM (#3939426)
Normally yes or as I said above it is a bug and you should report it there: http://gmvault.org/report_pb.html
Re:Gmvault: gmail backup. Liberate your emails by afterburner on Monday May 07, 2012 @12:09PM (#3939576)
Thanks for the reply. Your answer is confusing, but I see from your other replies that GMVault is supposed to preserve read/unread status.
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @01:38PM (#3940038)
I responded to the wrong comment. Normally it should preserve unread messages
Re:Gmvault: gmail backup. Liberate your emails by eblume on Monday May 07, 2012 @02:04PM (#3940156)
Oh wow - this is really interesting. I just released a VERY similar program called `gmail-safe` yesterday. I was going to do a Show HN sometime today.

If anyone is interested, here is the URI: http://eblume.github.com/gmail_safe/

Note that this is my first Node app. It needs a lot of polish. It is published under the MIT license, though, which some people here might enjoy.

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @10:34AM (#3939143)
tools is still in beta. Comments, features are welcome.
Re:Gmvault: gmail backup. Liberate your emails by orta on Monday May 07, 2012 @10:38AM (#3939152)
I love the idea, but I wasn't able to use it. http://cl.ly/2m170D012X370n1g2K0S

OSX has some niceties for python apps, you could use py2app to make it an actual binary rather than a folder or bundlebuilder.

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @11:08AM (#3939286)
Hi thanks for the feedback. I will try to use the py2app application. If the binary version doesn't work, you also do a standard python installation (http://gmvault.org/install.html#py_install).
Re:Gmvault: gmail backup. Liberate your emails by gglanzani on Monday May 07, 2012 @11:19AM (#3939338)
Same here. Installing with pip (not in a virtualenv), and I get

    Cannot find the python executable to set env var PYTHON_BIN. 
    Please check where your python binary is.
Re:Gmvault: gmail backup. Liberate your emails by ibejoeb on Monday May 07, 2012 @11:37AM (#3939428)
if python is in your path, just edit gmvault, delete the PYTHON_BIN stuff starting at line 24 and add PYTHON_BIN="python"

That should work if python is on your path.

Re:Gmvault: gmail backup. Liberate your emails by gglanzani on Monday May 07, 2012 @11:50AM (#3939492)
Thanks, works like a charm now.
Re:Gmvault: gmail backup. Liberate your emails by michaelmior on Monday May 07, 2012 @01:18PM (#3939920)
Yeah. Curious why PYTHON_BIN is required. I'd rather just have it use whatever python points to by default.
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @02:22PM (#3940227)
Yes your are right. I will fix the script to look for the default python.
Re:Gmvault: gmail backup. Liberate your emails by Judson on Monday May 07, 2012 @10:53AM (#3939214)
Seems like the docs are a bit lacking at the moment, but if you open the terminal and change directories to (in your case) "~/Downloads/gmvault-v1.0-beta/bin" and then run "./gmvault" it should work.
Re:Gmvault: gmail backup. Liberate your emails by mikemarotti on Monday May 07, 2012 @10:59AM (#3939241)
Still not working for me on OS X. I CDed my way into gmvault-v1.0-beta/bin, but when I ./gmvault sync [email protected], I get this:

http://i.imgur.com/yLzyy.png

Re:Gmvault: gmail backup. Liberate your emails by pdubs on Monday May 07, 2012 @10:51AM (#3939208)
For Windows:

- Require admin for installer (http://msdn.microsoft.com/en-us/library/bb756929.aspx)

- Add to Start Menu

- Doesn't show up in my installed programs list = no standard way to uninstall

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @11:05AM (#3939268)
Thanks for the feedback. I have not tested deployment on Vista but on WinXP and Win7. You didn't need to be an admin as far as I saw. The integration in the menu,showing up in the installed program as well as uninstall is in the version 1.1 that should be released next week. I wanted to see if some people would be interested by such tool.
Re:Gmvault: gmail backup. Liberate your emails by pdubs on Monday May 07, 2012 @11:09AM (#3939288)
The installer needs admin. Can't write to "Program Files" otherwise.
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @11:14AM (#3939313)
Ok got it and will add it in the next version. Still you can install it anywhere so put it somewhere else in the mean time.
Re:Gmvault: gmail backup. Liberate your emails by carsonm on Monday May 07, 2012 @11:25AM (#3939360)
On Vista64: made it through all install screens. No desktop shortcut (even though I asked for one), had to nav to install dir to find it. Ran uninstall and it only did a partial uninstall (I've still got a gunky folder in program files).
Re:Gmvault: gmail backup. Liberate your emails by PanMan on Monday May 07, 2012 @12:28PM (#3939679)
Nice tool! I think the default sync interface should show a progress bar (like wget). Now it says: Processing 7890 emails, but then it prints a line for every email. I don't need to see every email in a list, but I would like to see how long it takes to complete. Update: I see it does print that every once in a while. I would skip the other lines... :)
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @02:03PM (#3940147)
Thanks for the feedback. I will think on how to present operation progresses (progress bar and so on with curses and so on)
Re:Gmvault: gmail backup. Liberate your emails by iloverobots on Monday May 07, 2012 @08:47PM (#3941659)
I think it is great that you are getting a lot of good feedback and constructive criticism from the community, but I just wanted to say thank you! I've been looking for a simple tool like this for a while, and Gmvault is perfect. I'm sure that you will add polish and new features in the future, but I'm glad that you released when you did.
Re:Gmvault: gmail backup. Liberate your emails by espinchi on Monday May 07, 2012 @10:39AM (#3939158)
My first thought was "cool, I certainly have to use this", and switched to something else.

I just came back and started to perform a backup. I think you should, too. This is insurance.

For the author: the link from the "Learn More" is broken. It should probably point to install, not documentation.

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @02:19PM (#3940216)
Thanks I fixed it. Sorry for the premature launch I think it was somehow a mistake (too early) but I needed a boost to be sure that I was doing something useful.
Re:Gmvault: gmail backup. Liberate your emails by sneak on Monday May 07, 2012 @11:56AM (#3939518)
I think people familiar with command-line tools are already probably doing what I do, which is to use mbsync to sync a remote gmail imap account to a local maildir. It even easily supports multiple sync account/maildir pairs via its somewhat confusing config file format.

http://isync.sourceforge.net/mbsync.html

Re:Gmvault: gmail backup. Liberate your emails by ernestipark on Monday May 07, 2012 @10:49AM (#3939201)
If this fails/stops in the middle of syncing, will it restart at the point of failure or start from the beginning again?
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @10:55AM (#3939225)
Yes it has these kind of mechanisms are embedded: If there is an error in the middle of a syncing then Gmvault will wait few seconds and try to restart the current operation. After 4 attempts it will leave in error. Gmail imap servers can start to throttle the transfer and also cut the connection. Gmvault also has a restart mode (option --restart) to restart where it was. Actually up to 20 emails before because Gmvault save its "position" (email id synced or restored sucessfully) regularly.
Re:Gmvault: gmail backup. Liberate your emails by epo on Tuesday May 08, 2012 @11:29AM (#3944095)
As it stands, this could not work with local mail clients because of the custom storage format. Why is that, gmail meta data?

It would be very impressive if gmailvault functionality could be combined with a local mail client then you could get both a full (uploadable to gmail) backup of the gmail-box and non-browser access.

Re:Gmvault: gmail backup. Liberate your emails by chbrown on Monday May 07, 2012 @02:00PM (#3940133)
No resume functionality? Or am I just missing something? I've got ~3 GB of emails in my Gmail, and GVault's ETA is 4 hours.

It already timed-out once (no discernable reason), and after restarting, went right to email number 1 (forgetting about the 1800 emails it had already gotten through).

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @02:13PM (#3940188)
Thanks for the feedback. There is a restart functionality use the --restart option (see gmvault sync -h for more info). Also note that when you restart from scratch, if the email has already been downloaded and is identical then the download is not performed. So only scanning the mailbox is faster than having downloads.

Regarding the timeout, please send me the error message you had and if it is a bug I will fix it but note that sometimes Gmail cut the connection without any reasons. There is also a retry reconnect process (up to 4 times) if it is not a fatal error (cannot recover from them).

Re:Gmvault: gmail backup. Liberate your emails by chbrown on Monday May 07, 2012 @02:42PM (#3940355)
Seems like this guy is getting the same error:

https://github.com/gaubert/gmvault/issues/4

(Issue number 4 on the github project.)

I added my output to the issue.

I'm on Gmvault v1.0-beta from pypi. It doesn't recognize the --restart option. "gmvault: error: unrecognized arguments: --restart"

Re:Gmvault: gmail backup. Liberate your emails by davidradcliffe on Monday May 07, 2012 @03:29PM (#3940568)
Restart doesn't seem to be available. https://github.com/gaubert/gmvault/issues/4
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Tuesday May 08, 2012 @09:50AM (#3943572)
yes it is there for the restore operation but not for sync. It will be available in the next version (to be released in 2 weeks)
Re:Gmvault: gmail backup. Liberate your emails by andrewpi on Monday May 07, 2012 @11:20AM (#3939344)
Does this use SSL to grab the emails?
Re:Gmvault: gmail backup. Liberate your emails by callahad on Monday May 07, 2012 @11:34AM (#3939412)
Be default, yes: https://github.com/gaubert/gmvault/blob/master/src/gmv/imap_...

However, if I recall correctly, Python's built-in SSL support doesn't do certificate verification, so you're still completely open to man in the middle attacks.

Re:Gmvault: gmail backup. Liberate your emails by SoftwareMaven on Monday May 07, 2012 @12:02PM (#3939541)
That's a good point, and a tool like this probably really should be verifying the host.

(To the author) See http://stackoverflow.com/questions/1087227/validate-ssl-cert... for multiple options to accomplish this.

Re:Gmvault: gmail backup. Liberate your emails by Glowbox on Monday May 07, 2012 @11:09AM (#3939290)
It didn't work for me (TypeError: 'NoneType' object is not iterable), I opened an issue on github.
Re:Gmvault: gmail backup. Liberate your emails by mattjaynes on Monday May 07, 2012 @05:50PM (#3941126)
Here's a workaround from the GH issue's comments:

Solution: set 'Show in IMAP' in Settings->Labels->All Mail on gmail.com

https://github.com/gaubert/gmvault/issues/2#issuecomment-555...

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @11:41AM (#3939447)
ok thanks. I will study the issue and fix it.
Re:Gmvault: gmail backup. Liberate your emails by igurari on Monday May 07, 2012 @11:17AM (#3939327)
You might want to consider another name in light of the Google Vault product: http://www.google.com/enterprise/apps/business/products.html...
Re:Gmvault: gmail backup. Liberate your emails by zyb09 on Monday May 07, 2012 @12:06PM (#3939562)
Wow, very cool! This is exactly what I needed right now. I had bad dreams about what would happen if my Google account disappeared all of the sudden, but didn't do anything about it yet. Now I will be able to sleep better!
Re:Gmvault: gmail backup. Liberate your emails by delinquentme on Monday May 07, 2012 @02:10PM (#3940176)
Has no one mentioned search? intra-gmail search is nothing short of an atrocity compared to the google.com search... A search feature capturing partial terms "Aft" in "Afternoon" would more than make this service viable.
Re:Gmvault: gmail backup. Liberate your emails by wooptoo on Tuesday May 08, 2012 @03:40AM (#3942666)
I've been doing this for quite some time using getmail https://wiki.archlinux.org/index.php/Backup_Gmail_with_getma...
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Tuesday May 08, 2012 @07:51AM (#3943166)
It is only one way: Gmail to disk. When you restore the emails to a Gmail account you will loose part of the info (labels, ....).
Re:Gmvault: gmail backup. Liberate your emails by villagefool on Monday May 07, 2012 @12:52PM (#3939812)
"After that Gmvault will automatically authenticate itself using the credentials stored in $HOME/.gmvault (or %HOME%/.gmvault for Windows). " how are the credentials stored offline?
Re:Gmvault: gmail backup. Liberate your emails by hmottestad on Monday May 07, 2012 @01:03PM (#3939853)
Probably as clear text. You can delete the file if you want to.
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @02:24PM (#3940235)
Nop they are stored encrypted with a key randomly generated
Re:Gmvault: gmail backup. Liberate your emails by csabapalfi on Tuesday May 08, 2012 @08:06AM (#3943205)
How is this better than http://code.google.com/p/got-your-back/ which does almost exactly the same thing?
Re:Gmvault: gmail backup. Liberate your emails by bvi on Monday May 07, 2012 @11:30AM (#3939392)
When restoring a gmail account (say I want to upload all the backed-up emails to a new account), would the date information be preserved as well?
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @11:36AM (#3939417)
Yes of course. Date, Gmail labels and IMAP flags (READ, UNREAD, ...) are preserved. Otherwise it is a bug so please refer to http://gmvault.org/report_pb.html
Re:Gmvault: gmail backup. Liberate your emails by bvi on Wednesday May 09, 2012 @05:34AM (#3947747)
Another question: Does gmvault work behind a proxy?
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Wednesday May 09, 2012 @02:59PM (#3949987)
If the proxy let you connect to the Gmail IMAP server, I don't see why it wouldn't work
Re:Gmvault: gmail backup. Liberate your emails by bob87 on Monday May 07, 2012 @12:01PM (#3939533)
What is the switch to encrypt the archives? gmvault -e? I haven't been able to find it in the documentation.
Re:Gmvault: gmail backup. Liberate your emails by Drbble on Tuesday May 08, 2012 @11:58PM (#3947041)
Why would a techie need this product? We know how to turn on POP3 in a mail program.
Re:Gmvault: gmail backup. Liberate your emails by LyleK on Monday May 07, 2012 @01:24PM (#3939958)
Can this store mail in mbox format? In what header do the gmail labels go?
Re:Gmvault: gmail backup. Liberate your emails by callahad on Monday May 07, 2012 @01:58PM (#3940124)
The source is pretty easy to read. Here's how it's working: https://github.com/gaubert/gmvault/blob/master/src/gmv/gmvau...

(It stores each mail in two separate files: a .eml file with the message body, and a .meta file with metadata.)

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @03:34PM (#3940588)
I will take that as a compliment. Yes files are all stored individually as .eml file. All the extra Gmail info (labels, ...) goes in .meta
Re:Gmvault: gmail backup. Liberate your emails by pdk on Monday May 07, 2012 @11:06AM (#3939275)
Is there a way to make Thunderbird or Mac's Mail do the same thing?
Re:Gmvault: gmail backup. Liberate your emails by callahad on Monday May 07, 2012 @11:13AM (#3939303)
What do you mean? By default, both Thunderbird and Mail.app should fully download and locally save an archive of your mail.

To verify this in Thunderbird, check out Tools -> Account Settings, then go to the "Synchronization & Storage" page. Make sure it's set to "Keep messages for this accounts on this computer," "Synchronize all messages locally regardless of age," and "Don't delete any messages." You can click the "Advanced..." button if you only want to sync certain folders.

To force a sync, you can go to File -> Offline -> Download/Sync Now, but you shouldn't ever have to do that with the above settings.

Re:Gmvault: gmail backup. Liberate your emails by camiller on Monday May 07, 2012 @11:28AM (#3939376)
Yes, but it won't keep the gmail labels etc. And I doubt it would do a restore to gmail.
Re:Gmvault: gmail backup. Liberate your emails by probably on Monday May 07, 2012 @12:01PM (#3939536)
Ah, so this is the value-added proposition.
Re:Gmvault: gmail backup. Liberate your emails by waynemr on Monday May 07, 2012 @10:51PM (#3942007)
does this have any issues when you have 2-part authentication configured for Gmail? Well, I guess I'll find out in a second and report back :)
Re:Gmvault: gmail backup. Liberate your emails by ljosa on Monday May 07, 2012 @02:16PM (#3940204)
How does this compare to mbsync?
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @03:38PM (#3940603)
mbsync is a IMAP sync tool. Gmvault is a dedicated Gmail tool so it preserves all Gmail specific attributes like the labels, ... and allow you to restore all your emails in a Gmail account. With mbsync you might be able to upload your emails on a gmail account but you would then loose lots of information and your restored gmail account would be end up being very different.
Re:Gmvault: gmail backup. Liberate your emails by fogol on Monday May 07, 2012 @12:13PM (#3939604)
Is there any data transmitted to servers other than Google's?
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @03:32PM (#3940580)
Nop of course not. You can check the sources to be sure that Gmvault is only talking to Gmail. You can also use XOAuth (token security mechanism) to allow Gmvault accessing your account. This is by the way the recommended authentication way.
Re:Gmvault: gmail backup. Liberate your emails by creativityhurts on Monday May 07, 2012 @03:20PM (#3940525)
OP: I understand I will collect down votes with this comment but, seriously, you gave credit to everybody in the footer except to Twitter Bootstrap, which you didn't even bother to personalize. Is that part of the brogrammer code, guzzle down some redbulls, fire up bootstrap and don't even bother about it?

Invest a bit of time in the looks of your service/startup, if it looks like the next service/startup, it's just another Boostrap themed website that people (I assume) are tired of.

Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @03:53PM (#3940664)
Uuuuh I think there is scale issue. This is an open source tool that I am willing to support. I do not intend to create a start-up here. Still you are right and I will reference bootstrap.
Re:Gmvault: gmail backup. Liberate your emails by creativityhurts on Monday May 07, 2012 @04:04PM (#3940727)
I understand that and it's pretty awesome. Have the frontend on Github and I can help you tweak it out. Open source stuff should look awesome as well.
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Tuesday May 08, 2012 @02:55AM (#3942580)
It is available on the gh-pages branch of the Gmvault github repository (https://github.com/gaubert/gmvault/tree/gh-pages). Pull it and submit your suggestions. Many thanks.
Re:Gmvault: gmail backup. Liberate your emails by jenius on Monday May 07, 2012 @11:56AM (#3939516)
Crappy design + twitter bootstrap default = tab closed. If you are serious about releasing a product ffs make sure it's polished. If the attention to detail I see in the splash page is similar to the attention to detail in the actual product (which is what I assume automatically), my faith in it is close to zero.

This is ESPECIALLY important when I'm authorizing you with access to my emails -- and there is no way I would do that for someone that I assume is not serious about their product.

Re:Gmvault: gmail backup. Liberate your emails by swaits on Monday May 07, 2012 @12:12PM (#3939597)
You left out the part where you were swirling your wine in its glass and adjusting your top hat while angling your nose sharply toward the sky.

HN is a place where lots of launches happen. A place where open mindedness is a plus. Seriously.. if this is actually your attitude, you might miss some cool things. Take a step away from the hive mindset every now and then.

Re:Gmvault: gmail backup. Liberate your emails by jenius on Monday May 07, 2012 @02:40PM (#3940336)
There's no hive mindset here - I just looked at the page, noticed that it had really poor and sloppy design, and assumed that it was a poor and sloppy product. It's called 'judging a book by it's cover' and is something that everyone does automatically (regardless of the classic advice).

Craigslist aside, you'll be hard pressed to find a successful product that has no attention paid to design whatsoever. Design is important, and it makes me really sad to see it neglected, and so many people supporting not caring about design here (as indicated by comments like this and downvotes)

Re:Gmvault: gmail backup. Liberate your emails by icebraining on Monday May 07, 2012 @03:12PM (#3940498)
Design is important, but this project has a decent design, your prejudice against Bootstrap -which I'm pretty sure most people don't share- notwithstanding.

The typography is decent, the utility of the project is immediately understood (without even having to scroll), the call to action is present and it's two clicks from the main page to having the application downloading.

You're advocating for "prettiness," which is frankly the least important part of design.

Re:Gmvault: gmail backup. Liberate your emails by ardillamorris on Monday May 07, 2012 @12:05PM (#3939554)
I think you are misjudging. What if he spent a lot of time in the product making sure it works well without too much care for "shininess"? If anything, using twitter bootstrap shows that he cared a bit to make it look usable from a splash site point of view. I think we should give feedback on how the product is actually working rather than complaining that he's using twitter bootstrap.
Re:Gmvault: gmail backup. Liberate your emails by zoobert on Monday May 07, 2012 @03:49PM (#3940645)
Thanks for the support. I am not a designer, I am not working full time on this product and my free time is quite limited. Still I spent lots of time designing the logo. I kind of like it as it is very simple and tells you what the product is. Regarding the website, yes I used bootstrap because it is convenient and give you a good modern look quickly. I am not a web designer and didn't want to spend 60% of my project time on that part. For the moment I prefer to spend more time on the tool itself.

If somebody wants to help to improve the website and the documentation please contact me.

Re:Gmvault: gmail backup. Liberate your emails by Estragon on Monday May 07, 2012 @12:05PM (#3939551)
My taste for design is pretty weak, so I'm always interested in comments like this. The design looks OK to me. What are the problems with it?
Re:Gmvault: gmail backup. Liberate your emails by kreek on Monday May 07, 2012 @05:41PM (#3941094)
The main issue, for me, is that "Gmvault Gmail Backup" and the logo are unbalanced. The logo is too big, and its colors could be more sophisticated. If those things were cleaned up it would look fine (unless you're allergic to boostrap).
Re:Gmvault: gmail backup. Liberate your emails by jenius on Monday May 07, 2012 @02:34PM (#3940290)
Wow, really surprised this was downvoted. Perhaps it came off as too judgmental and arrogant - if that's the case I very much apologize - didn't intend it to be like that. Just a little tough love : )

I thought people here valued polish and attention to detail... while this may or may not be a fine product, nobody can deny that there was absolutely no effort put into the design. This is really significant - all the downvotes here indicate to me "fuck design, we don't care how your product looks" which is really backwards for hacker news...

Re:Gmvault: gmail backup. Liberate your emails by boreacrat on Monday May 07, 2012 @09:36PM (#3941765)
In my experience most open source tools like this have a sentence-long description on their sourceforge page or a brief introduction on their github repo, which puts this miles ahead in terms of design effort.
Re:Gmvault: gmail backup. Liberate your emails by haldean on Monday May 07, 2012 @12:01PM (#3939534)
This seems to be an unpopular idea but I completely agree. I don't mind the Bootstrap default theme, but the icon is bad enough that I lose trust in it.