Re:Automatically encrypt your Gmail account
by theboywho on Tuesday June 25, 2013 @01:18PM
(#5940976)
This has good intentions but misses the main point of encryption : no third entity should ever have a copy of the unencrypted message at any given time.
Once your emails get into google servers, the NSA has made a copy of them. NSA copies your emails before you even read them.
You are protecting yourself from someone who has access to your gmail account, not from someone who has a BACKUP of your gmail account.
Re:Automatically encrypt your Gmail account
by DrJosiah on Tuesday June 25, 2013 @02:29PM
(#5941451)
Your first sentence, precisely.
And really, it doesn't matter whether the NSA has explicit connections into Gmail, your email is backed up periodically by Google already, so plaintext is available to interested parties for quite a while even if you were to empty your trash.
But even before that, many SMTP servers transmit emails in the clear, so it wouldn't matter if the NSA had their hooks into Google if they've got their hooks into the backbones that Google peers with.
Oh, and you lose all read state, all information about when an email was sent, any labels, stars, any reference headers for threading, ...
Seemingly the only threat that this addresses is "someone may hack into my email account and I don't want them to be able to read my email". There are several other methods for solving that particular issue without destroying email metadata and the usefulness of email itself.
Re:Automatically encrypt your Gmail account
by themckman on Tuesday June 25, 2013 @02:13PM
(#5941355)
> Once your emails get into google servers, the NSA has made a copy of them. NSA copies your emails before you even read them.
I haven't followed the NSA Prism story as closely as maybe I should have, but I'm curious: is this TRUE? Like, is it indisputable fact that the NSA has all your email, or, is it more like, we can't be sure what they do and don't have access to, therefore, it's better to assume the worst?
Re:Automatically encrypt your Gmail account
by yen223 on Wednesday June 26, 2013 @12:11AM
(#5944141)
themckman's question is a valid one though. So far, almost everything we know about the NSA's surveillance capabilities seem to come from those leaked slides, and frankly, I don't think a couple of slides are going to be technically accurate. The truth is, we simply do not know the real extent of the NSA's reach.
Re:Automatically encrypt your Gmail account
by VladRussian2 on Tuesday June 25, 2013 @03:22PM
(#5941771)
>I haven't followed the NSA Prism story as closely as maybe I should have, but I'm curious: is this TRUE?
it is the "least untruthful statement".
> or, is it more like, we can't be sure what they do and don't have access to, therefore, it's better to assume the worst?
it is just hard to imagine how they don't have access to something. They obviously capable of accessing everything they want. Thus if they don't access something, it would mean they don't want to. Ed absurdum.
"Hellman has been a long-time contributor to the computer privacy debate. He and Diffie were the most prominent critics of the short key size of the Data Encryption Standard in 1975. An audio recording survives of their review of DES at Stanford in 1976 with Dennis Branstad of NBS and representatives of the National Security Agency.[12] Their concern was well-founded: subsequent history has shown not only that NSA actively intervened with IBM and NBS to shorten the key size ..."
Re:Automatically encrypt your Gmail account
by packetslave on Tuesday June 25, 2013 @02:29PM
(#5941452)
Not sure how that's relevant to "Once your emails get into google servers, the NSA has made a copy of them. NSA copies your emails before you even read them"?
Also, please explain how you would implement a webmail service without storing emails.
Re:Automatically encrypt your Gmail account
by etherael on Tuesday June 25, 2013 @01:22PM
(#5940994)
True, it doesn't protect from every threat model in existence, I've been considering setting up some kind of third party reflector model, but the problem there is that the termination point for the plaintext recipients still requires trust at some level.
I recognise this isn't perfect, but the very fact that in various stories a fuss has been raised about data retention times indicates it might not be completely useless to close the window of vulnerability, another comment in this thread mentions monitoring the incoming messages via IMAP IDLE also which is another idea, but once again there is a non zero window of plaintext messages on the server.
And if nothing else, the thousands of spam messages this will armor with strong encryption will give the fascists something to waste their time on.
Re:Automatically encrypt your Gmail account
by jiggy2011 on Tuesday June 25, 2013 @09:17PM
(#5943518)
The issue here is that you then have to do everything client side. Search,spam/malware filtering etc. So you need a copy of all of the mail on the client. Basically you go back to the days of POP3 or having your gmail account taking 10 minutes to log you in while it downloads everything to local storage.
Re:Automatically encrypt your Gmail account
by methehack on Tuesday June 25, 2013 @02:15PM
(#5941370)
Couldn't browsers be juiced up to support client side encryption via local private key of a text area before form submission? That coupled with automatic public key decryption would enable gmail, for instance, to actually be secure(-ish-at-least-more-so). I think. Yes?
The general facility of client side private key encryption before form submission of both text fields, areas, and files seems like it would be very useful. Not sure why that's not planned for, say, html5. Odds are I'm sprinkling my own ignorance all over this :)
If this sort of functionality was standardised, simplified and baked in to the major browsers, we'd be able to build all sorts of wonderful software on top of it.
Re:Automatically encrypt your Gmail account
by methehack on Tuesday June 25, 2013 @03:36PM
(#5941862)
Seems like if you really cared for the contents of a textarea, for instance, you could tokenize the text client side and encrypt each token with the client side private key then you could similarly encrypt the search tokens client side and search serverside not knowing what you were searching for.
However, I take your point. Lots of work, not quite the same. It still seems like the facility should be baked in though so that application's could make the proper tradeoffs.
Re:Automatically encrypt your Gmail account
by michaelt on Tuesday June 25, 2013 @04:34PM
(#5942268)
Products like CipherCloud reportedly work like you suggest. Unfortunately it's not very secure.
If you split the text into words, discard case and encrypt each word, the NSA can just e-mail you a dictionary file, match the line numbers in the dictionary file ciphertext to line numbers in the dictionary file plaintext, and they've got your secret decoder ring (at least for every word in the dictionary file).
Re:Automatically encrypt your Gmail account
by arjunnarayan on Tuesday June 25, 2013 @04:04PM
(#5942055)
Seems super vulnerable to frequency analysis though. However, if this is a path you might want to go down, you might want to look at CryptDB, a research project that looks at keeping a server side encrypted database and allows for queries in a principled way: http://css.csail.mit.edu/cryptdb/
Re:Automatically encrypt your Gmail account
by sp332 on Tuesday June 25, 2013 @04:17PM
(#5942144)
Something like text search should only need partially-homomorphic encryption. For example: encrypt each byte with the same key. Then to search, encrypt the bytes of your search term and send them to the backend. It should be able to find them without knowing what your search term was. There are issues with this exact scheme of course but you get the idea!
Re:Automatically encrypt your Gmail account
by etherael on Tuesday June 25, 2013 @01:51PM
(#5941209)
Because I haven't yet messed around with parsing just the message body out for encryption to then do an imaplib append with it.
That said, I think this is worth doing, so it's currently in progress. I just don't have a ton of time at the moment, pull requests eagerly accepted though. :)
Re:Automatically encrypt your Gmail account
by etherael on Tuesday June 25, 2013 @10:48PM
(#5943847)
I had a brief look at the GMVault source to see if there were any obvious msg constructing bits, but nothing is jumping out at me, do you happen to know where the message construction is done here?
Re:Automatically encrypt your Gmail account
by 6cxs2hd6 on Tuesday June 25, 2013 @05:04PM
(#5942447)
This. I gave up on Rss2Email and rolled my own version using IMAP instead of SMTP. Deliverability from iffy to 100%. Furthermore, you can pre-select the folder (label).
Re:Automatically encrypt your Gmail account
by CasimirCelerity on Tuesday June 25, 2013 @08:39PM
(#5943407)
If you wouldn't mind sharing I'd be interested in seeing/using this. Currently I have a filter in gmail that matches emails that are from myself and have "rss" in them, which paired with a dedicated sendmail listening on my computer (opensmtpd, I'd highly recommend checking it out) has lead to me getting 100%. Your method sounds interesting though!
Re:Automatically encrypt your Gmail account
by Scramblejams on Tuesday June 25, 2013 @01:35PM
(#5941102)
Does anybody offer an encrypted-on-the-server email setup which allows easy key revocation? It's desirable (revoke a key you used on your iPhone when you sell it, or use a key a single time from an untrusted PC, etc.), but really inconvenient because each email would need to be encrypted for each key. And when you create a new key, if you want to read emails sent before the key's creation you'll need some way for the server to go back and reencrypt all the older emails, etc. Seems like a can of worms, but it'd be awesome if someone somehow made it convenient. I might just be wishing for magic, though.
EDIT: 'Sup with the downvote? Explain what's wrong with my post.
Re:Automatically encrypt your Gmail account
by bcl on Tuesday June 25, 2013 @01:29PM
(#5941050)
No. GPG doesn't use the public key to do the actual encryption, it generates an intermediate key, uses that to encrypt the message and encrypts that intermediate key with your public key.
Re:Automatically encrypt your Gmail account
by wkornewald on Tuesday June 25, 2013 @03:18PM
(#5941745)
Maybe this is too far-fetched and it's beyond what is technically possible today, but wouldn't the decrypted message be the plaintext for the session key and wouldn't then the session key basically be the plaintext for the public key? I suppose it's considered unbreakable because you only get one plaintext per session key?
Re:Automatically encrypt your Gmail account
by etherael on Tuesday June 25, 2013 @01:14PM
(#5940940)
That I guess would depend on the algo for the PGP key in question. The default these days is RSA 2048 for gpg, which as far as I know is not vulnerable to known plaintext attacks.
Re:Automatically encrypt your Gmail account
by sp332 on Tuesday June 25, 2013 @01:58PM
(#5941252)
The trouble is, if you use the same key to encrypt the same plaintext, you'll get the same ciphertext. Then an eavesdropper can compare the ciphertext you sent her with the ciphertext you sent someone else and see if they are the same.
Re:Automatically encrypt your Gmail account
by croikle on Tuesday June 25, 2013 @02:51PM
(#5941584)
This is why all worthwhile encryption schemes are nondeterministic, incorporating randomness. If you encrypt the same data twice with GPG, the results will not be the same.
Re:Automatically encrypt your Gmail account
by mannkind on Tuesday June 25, 2013 @01:16PM
(#5940961)
Funny … I've been writing a python script that uses IMAP IDLE to monitor your inbox and encrypt incoming email (while retaining from/subject/date) and delete the plaintext version.
Unfortunately sometimes the IDLE errors and I haven't been able to figure out why. And I've yet to get Gmail to actually delete the email (vs just moving it to the trash)
Re:Automatically encrypt your Gmail account
by etherael on Tuesday June 25, 2013 @01:18PM
(#5940974)
I think I've run into this exact same problem with the delete, it reports that the flag has been set, but post expunge, nothing has happened to the message in question.
Re:Automatically encrypt your Gmail account
by etherael on Thursday June 27, 2013 @10:19AM
(#5952396)
Hey just wanted to give my thanks to you on this, using your code as a guide I was able to add the imap append level functionality I had been holding out on due to not wanting to mess with the nightmare of MIME encoding and walking through multipart attachments et al. Thanks, you saved me a ton of time there.
It of course still doesn't keep out the scary folks, as they'll just tap the network beforehand, but it does raise the bar quite a bit from other 3rd parties snooping. Combine with a crypto-stick, https://www.crypto-stick.com/, and good practices on the mail server and you're in the best shape anyone can be until everyone encrypts their outgoing email.
Re:Automatically encrypt your Gmail account
by unreal37 on Tuesday June 25, 2013 @01:49PM
(#5941192)
I like the idea of this. Yes, it doesn't encrypt the message from sender to you, but then you require the cooperation of the sender for that.
I think I will do this. I was thinking of downloading all my gmail to my local anyways and then deleting them since emails over 180 days old don't require a warrant to read right?
Re:Automatically encrypt your Gmail account
by guelo on Tuesday June 25, 2013 @03:22PM
(#5941774)
Even if there were a perfect solution for storing encrypted email it would still be unworkable because you'd lose the ability to search your email. It seems like too big of a feature to lose. Have crypto people come up with a solution for building encrypted search indexes?
Re:Automatically encrypt your Gmail account
by grobot on Tuesday June 25, 2013 @09:51PM
(#5943626)
There's an interesting interview with Julian Fay of Senetas @ http://risky.biz/RB282 discussing homomorphic encryption. (Also mentioned in a couple of comments above.)
Re:Automatically encrypt your Gmail account
by hellcow on Tuesday June 25, 2013 @02:09PM
(#5941335)
I'm getting an occasional "TypeError: 'NoneType' object is not subscriptable." Added try/except, and it works like a dream on 99% of the emails. I'll just run it twice :)
Once your emails get into google servers, the NSA has made a copy of them. NSA copies your emails before you even read them.
You are protecting yourself from someone who has access to your gmail account, not from someone who has a BACKUP of your gmail account.
And really, it doesn't matter whether the NSA has explicit connections into Gmail, your email is backed up periodically by Google already, so plaintext is available to interested parties for quite a while even if you were to empty your trash.
But even before that, many SMTP servers transmit emails in the clear, so it wouldn't matter if the NSA had their hooks into Google if they've got their hooks into the backbones that Google peers with.
Oh, and you lose all read state, all information about when an email was sent, any labels, stars, any reference headers for threading, ...
Seemingly the only threat that this addresses is "someone may hack into my email account and I don't want them to be able to read my email". There are several other methods for solving that particular issue without destroying email metadata and the usefulness of email itself.
I haven't followed the NSA Prism story as closely as maybe I should have, but I'm curious: is this TRUE? Like, is it indisputable fact that the NSA has all your email, or, is it more like, we can't be sure what they do and don't have access to, therefore, it's better to assume the worst?
FAIRVIEW, BLARNEY, and two whose names were redacted exist in addition to PRISM. They are tapping the pipes and grabbing stuff off of the server.
They can pretty much have whatever they want.
it is the "least untruthful statement".
> or, is it more like, we can't be sure what they do and don't have access to, therefore, it's better to assume the worst?
it is just hard to imagine how they don't have access to something. They obviously capable of accessing everything they want. Thus if they don't access something, it would mean they don't want to. Ed absurdum.
Interesting piece of history btw:
http://en.wikipedia.org/wiki/Martin_Hellman#Computer_privacy...
"Hellman has been a long-time contributor to the computer privacy debate. He and Diffie were the most prominent critics of the short key size of the Data Encryption Standard in 1975. An audio recording survives of their review of DES at Stanford in 1976 with Dennis Branstad of NBS and representatives of the National Security Agency.[12] Their concern was well-founded: subsequent history has shown not only that NSA actively intervened with IBM and NBS to shorten the key size ..."
Also, please explain how you would implement a webmail service without storing emails.
"is it indisputable fact that the NSA has all your email, or, is it more like, we can't be sure what they do and don't have access to"
They don't need to have second hand copies of the mail when they can just tell Google to give them access.
"implement a webmail service without storing emails." is not relevant to anything I said.
I recognise this isn't perfect, but the very fact that in various stories a fuss has been raised about data retention times indicates it might not be completely useless to close the window of vulnerability, another comment in this thread mentions monitoring the incoming messages via IMAP IDLE also which is another idea, but once again there is a non zero window of plaintext messages on the server.
And if nothing else, the thousands of spam messages this will armor with strong encryption will give the fascists something to waste their time on.
The first company that offers serious client-side encryption (with steganography + noise thrown in for good measure) is going to make a bundle.
Hint, hint.
The general facility of client side private key encryption before form submission of both text fields, areas, and files seems like it would be very useful. Not sure why that's not planned for, say, html5. Odds are I'm sprinkling my own ignorance all over this :)
If this sort of functionality was standardised, simplified and baked in to the major browsers, we'd be able to build all sorts of wonderful software on top of it.
However, I take your point. Lots of work, not quite the same. It still seems like the facility should be baked in though so that application's could make the proper tradeoffs.
If you split the text into words, discard case and encrypt each word, the NSA can just e-mail you a dictionary file, match the line numbers in the dictionary file ciphertext to line numbers in the dictionary file plaintext, and they've got your secret decoder ring (at least for every word in the dictionary file).
http://www.mailvelope.com/
That said, I think this is worth doing, so it's currently in progress. I just don't have a ton of time at the moment, pull requests eagerly accepted though. :)
EDIT: 'Sup with the downvote? Explain what's wrong with my post.
https://grepular.com/Automatically_Encrypting_all_Incoming_E...
result, data = mail.search(None,'(NOT BODY "BEGIN PGP MESSAGE")') ids = data[0] id_list = ids.split()
There's a chance "result" will indicate a failure and/or "data" will be None, causing the access to data[0] to throw an exception.
I haven't looked into what the API returns for "result" so I can't speculate on a fix, but I'm sure it should be easily handled.
Unfortunately sometimes the IDLE errors and I haven't been able to figure out why. And I've yet to get Gmail to actually delete the email (vs just moving it to the trash)
I'm still looking into it.
It works, but it's cobbled together and still has some issues I haven't been able to resolve.
It of course still doesn't keep out the scary folks, as they'll just tap the network beforehand, but it does raise the bar quite a bit from other 3rd parties snooping. Combine with a crypto-stick, https://www.crypto-stick.com/, and good practices on the mail server and you're in the best shape anyone can be until everyone encrypts their outgoing email.
I think I will do this. I was thinking of downloading all my gmail to my local anyways and then deleting them since emails over 180 days old don't require a warrant to read right?
Thank you for creating this.
http://www.syncdocs.com/syncdocs-screenshots/how-to-encrypt-...