News for hackers. Stuff that matters.
Re:Google has most of my email because it has all of yours (... by trjordan on Wednesday September 16, 2015 @06:01PM (#10230197)
Most systems never found a good way to encrypt data at rest.

You either have to let the user manage the keys / passphrase, giving up things like search and password recovery, or you have to manage the keys in a service, which doesn't provide privacy from the service that manages the keys.

Re:Google has most of my email because it has all of yours (... by bluecmd on Wednesday September 16, 2015 @06:03PM (#10230213)
Spam is also a problem. How do you do spam detection if you cannot read the message?
Re:Google has most of my email because it has all of yours (... by dredmorbius on Wednesday September 16, 2015 @07:35PM (#10230713)
Most spam isn't encrypted. The overhead's too high.

Behavioral methods might still work, particularly whitelisting/greylisting. Whitelisted senders will be passed, greylisted ones filtered. Spam can still be filtered locally with a key, if necessary, though that misses the leverage of delivery-time notification.

A notify-and-fetch dynamic might also work. Rather than delivering messages at send time, a notification that there is a message is sent, an on its strength, the message is later requested. Spammers have a much larger mail storage problem. Whitelisted senders might have mail delivered automatically. And collaborative spam filtering could mark and downrate spammer reputations before many recipients get to requesting the message, sparing them the spam.

Greylisting / teergrubing / delayed receipt (even just 1-2 retry intervals) cuts down much on spam as well.

Play the costs.

There are also distributed anonymous reputation systems, designed mostly for Tor / Web, though similar concepts for email might work. FAUST and Fair Anonymity:

https://gnunet.org/node/1704

http://arxiv.org/pdf/1412.4707v1.pdf

Re:Google has most of my email because it has all of yours (... by irixusr on Wednesday September 16, 2015 @06:13PM (#10230293)
A few years (almost two decades!!!) when the filters weren't as good I read a proposal to make an email system that charges $0.01 to the sender. Spammers would be bankrupt.

It was difficult to implement and up against an already entrenched tech.

With Bitcoin I've been thinking of that idea again. Could a payment system on top of existing email be created? The receiver of the email could get the senders penny and Bitcoin might get a killer app that doesn't involve drugs...

Re:Google has most of my email because it has all of yours (... by kpcyrd on Wednesday September 16, 2015 @07:09PM (#10230594)
Re:Google has most of my email because it has all of yours (... by irixusr on Thursday September 17, 2015 @09:10AM (#10233109)
Love it.

But seriously, does it still fail if I have a local filter were I strongly prioritize emails of ppl who show up on the BC ledger?

If ppl in high tech start doing this to lower their own email burden, I can envision normal business ppl copying the technique to lower their own.

Re:Google has most of my email because it has all of yours (... by derefr on Wednesday September 16, 2015 @06:26PM (#10230391)
It could be even more convenient, if it only charged for unauthorized contacts. Emails back and forth between friends/coworkers? No charge. Email newsletter you signed up for? One-time cost to them to send you the opt-in message. Random spammers? Never get authorized; have to pay every time.

It would also put a slight amount of friction in place for contacting people out-of-the-blue (when e.g. sending fan-mail to famous people)—but the fact that some stranger paid $0.05 to say something to you could also make you just fractionally more interested in what they have to say.

On the other hand, for accepting bug reports, help tickets, etc., there'd have to be some kind of email equivalent to an "800 number", that is free to initiate contact with. Either that, or a lot of behind-the-scenes pairing magic to get your email address into the directory service of all the products and services you use.

Re:Google has most of my email because it has all of yours (... by irixusr on Wednesday September 16, 2015 @06:30PM (#10230409)
You're assuming people want to be contacted by people in their address list :D

For me there's an annoying aunt who periodically send the latest get-mad-at-this email.

Or, how many times do we receive a mass email from friends who use CC instead of BCC and then we're flooded by everyone's replies?

If you're in my address book, then you should be charged more!

Re:Google has most of my email because it has all of yours (... by derefr on Wednesday September 16, 2015 @07:29PM (#10230689)
The difference, I think, is that you can at least apply individual filtering to the problems of annoying aunts and mass-emailing friends, of the same sort as you see with Facebook's "remain friends but unfollow" option.

Spam is hard because there's no manual filter you can write that targets "everyone you don't know", without removing the ability to be reached-out-to by real people who have a genuine desire to tell you something you care to hear.

Re:Google has most of my email because it has all of yours (... by scintill76 on Wednesday September 16, 2015 @07:13PM (#10230613)
Or use Hashcash, which is a proof-of-work algorithm created for anti-DoS and anti-spam, and the inspiration of Bitcoin's mining algorithm.

It's possible the botnets are strong enough to create Hashcash or mine Bitcoin and still spam enough to annoy us... and it would probably take either Google, Yahoo, or Microsoft announcing they would stop accepting legacy emails (where "legacy" could just be ones without Hashcash or BTC), for anyone to make a change.

Re:Google has most of my email because it has all of yours (... by bad_user on Wednesday September 16, 2015 @07:30PM (#10230695)
SMS messages are somewhere around $0.01 to $0.04 for sending in bulk, depending on region. Doesn't stop spammers.

And a fee will also never, ever fly for email, being not a matter of entrenched tech, but rather one of artificial scarcity, being the reason for why SMS is dying.

Re:Google has most of my email because it has all of yours (... by irixusr on Thursday September 17, 2015 @11:19PM (#10237333)
The artificial scarcity argument is interesting, but I don't think it applies here.

I'm not proposing paying a third party to send me email. You'd be paying me for my scarse resource - my time and inbox space

Re:Google has most of my email because it has all of yours (... by colechristensen on Wednesday September 16, 2015 @07:06PM (#10230582)
It's pretty simple, create an email client and/or server which bounces emails from new addresses indicating delivery costs 1¢ paid to the receiver.
Re:Google has most of my email because it has all of yours (... by Panino on Wednesday September 16, 2015 @08:09PM (#10230824)
A Spamhaus DNSBL alone drops 99% of spam with almost no FPs. Add DROP, fullbogons, and greylisting to increase the percentage further. None of these methods read the message body, and there are plenty of other options as well. I self-host and receive about 5 spam messages per year, all without looking at the message body.
Re:Google has most of my email because it has all of yours (... by ryanlol on Wednesday September 16, 2015 @11:09PM (#10231373)
I'm not sure if you know how spamhaus DNSBL works, "no FPs" is ridiculously far from the truth.

They make it near impossible for bigger hosts not to get blacklisted unless they fully comply with spamhaus.

Re:Google has most of my email because it has all of yours (... by DanBC on Thursday September 17, 2015 @04:30AM (#10232215)
Do you have any cites for this? Everything I've seen suggests that Zen has a very low false positive rate. That's the point of Zan - block a decent amount of spam and no real email so that your slower better filters can work.
Re:Google has most of my email because it has all of yours (... by ryanlol on Thursday September 17, 2015 @05:01AM (#10232296)
Spamhaus has a history of extorting larger ISPs into dropping their customers instead of just blocking said customer.

https://www.virusbtn.com/blog/2011/10_13.xml

It's worth noting that spamhaus had no real reason to do this as they had already blocked the hosting company a2b was providing bandwidth to, so blocking all of a2b didn't actually stop any more spam.

Zen is far far from not blocking any real email, they regularly block large ISPs that refuse too indiscriminately drop customers on their request.

Re:Google has most of my email because it has all of yours (... by DanBC on Thursday September 17, 2015 @12:23PM (#10234294)
From your link:

> Update: Spamhaus has now commented on the case in a blog post, explaining how Cyberbunker (also known as CB3ROB) has been involved in hosting malware and phishing sites. Ironically, this very week Spamhaus has been working with the Dutch hi-tech crime unit to investigate the criminal activity hosted by Cyberbunker and routed by A2B.

This is really your example of false positive blocking?

Re:Google has most of my email because it has all of yours (... by ryanlol on Friday September 18, 2015 @07:31AM (#10238564)
A2B was routing CB, CB was not using A2Bs IP space. Spam was not coming from A2B. A2Bs IP space was blocked by Spamhaus to force them to drop CB.

What exactly justified blocking A2Bs IP space here?

Spamhaus is a really shady organization with a history of unethical behavior, look up the nic.at fiasco as another example... Or just ask anyone who works in hosting.

Re:Google has most of my email because it has all of yours (... by DanBC on Friday September 18, 2015 @07:47AM (#10238607)
> Per Spamhaus policy, on October 6th, after notifying A2B several times since June without results, an SBL listing which A2B had been ignoring was escalated to the SBL's "providing a spam support service" category and increased to include one of A2B's IP ranges. The escalated SBL record SBL112638 listed 178.249.152.0/21 for providing routing "knowingly and for profit" to a rogue host known as "CB3ROB" or "Cyberbunker", an outfit which Spamhaus has long seen involved in hosting cybercrime and spam outfits. SBL listings of CB3ROB had been mounting steadily during 2011 for hosting malware, phishing and websites selling fraudulent goods advertised via spam. CB3ROB had announced that it would not terminate customers due to spam listings - an announcement which sent a golden invitation to even more spam and crime customers to the point where all of CB3ROB was placed on the Spamhaus DROP ("Don't Route Or Peer") list at the beginning of October.

That's exactly what people want from something like the SBL, which is why it's used by so many people.

Your reference to nic.at is weird - again they were providing services to a bunch of criminals.

When complaining about false positives it'd be really helpful if you could point to people who aren't fucking scumbags who are getting blocked.

Re:Google has most of my email because it has all of yours (... by tkinom on Wednesday September 16, 2015 @06:24PM (#10230378)
If you have the public keys of all senders, one can easily white/black list the known known/non-spammers. All the undecided goes into just one folder.

Probably not be that hard to sort out.

Re:Google has most of my email because it has all of yours (... by peterhunt on Wednesday September 16, 2015 @06:36PM (#10230446)
This is actually very hard to sort out and is a deal-breaker for end-to-end email encryption. https://moderncrypto.org/mail-archive/messaging/2014/000780....
Re:Google has most of my email because it has all of yours (... by mattmcknight on Thursday September 17, 2015 @09:07AM (#10233092)
But why would you need the sender's key? They need to encrypt with your public key, which you only provide to a limited list, and change when it gets blown. What we need is an automated way for requesting someone's key, approving or disapproving that request, and then storing their key for future use....in gmail.
Re:Google has most of my email because it has all of yours (... by devit on Wednesday September 16, 2015 @07:12PM (#10230609)
Do spam detection on the local machine, although unfortunately it will performs worse.
Re:Google has most of my email because it has all of yours (... by mattmcknight on Thursday September 17, 2015 @09:00AM (#10233067)
Don't give your public key out freely.
Re:Google has most of my email because it has all of yours (... by mtgx on Wednesday September 16, 2015 @07:19PM (#10230642)
Client-side.
Re:Google has most of my email because it has all of yours (... by escaped_hn on Wednesday September 16, 2015 @10:47PM (#10231312)
Make encrypting an email cost something. not necessarily money. kinda like minimg bitcoints but instead of getting bitcoins, you get to encrypt and send an email.
Re:Google has most of my email because it has all of yours (... by phire on Wednesday September 16, 2015 @11:18PM (#10231402)
As in, each email requires a bruteforced hash that takes about half a second to calculate on a desktop CPU, before it will be accepted by the mail server?

That's actually the best idea for spam reduction I've heard so far (which is not really saying a lot). Half a second won't be noticed by a normal user, but it will be noticed by people sending thousands or millions of emails.

Sure Spammer will install large GPUs hashing rigs and still manage to send thousands of emails per second, but it would cost them a lot more than it does now.

One problem will be phones, a hash that takes about half a second on a desktop will take tens of seconds on lower end mobile phones, which is hardly unworkable but you could offload the calculations to a 3rd party server (with a large GPU based hashing rig) for say a fraction of a cent, especially if the email contents were encrypted by the phone before hashing.

And it could be introduced without breaking the email system. Initially the presence of a hash will just be used as an additional spam filtering signal, but as support grows over time you can make it harder and harder for emails without a hash to get through.

Like bitcoins, you would need a mechanism to increase the required work over time, though it could just be ad-hoc based on what mail server operators choose to accept.

Re:Google has most of my email because it has all of yours (... by drblue on Thursday September 17, 2015 @12:38AM (#10231600)
You may want to take a look at hashcash[1]. It was a proof of work scheme for email invented in the late 90s, and they claim it was adopted by bitcoin[2]. (Sadly, it never caught on for its 'intended' purpose.)

[1]: http://www.hashcash.org/ [2]: http://www.hashcash.org/bitcoin/

Re:Google has most of my email because it has all of yours (... by Sanddancer on Thursday September 17, 2015 @12:40AM (#10231605)
The problem I can see there is with legitimate large mailing lists. Think security announcements, etc. Putting a burden like that on smaller teams, or teams without a lot of funding, could prove problematic.
Re:Google has most of my email because it has all of yours (... by phire on Thursday September 17, 2015 @03:09AM (#10231996)
You could deal with large regular mailing lists, you want to move to a system where users can subscribe to a signed mailing list and have the mail server remember that subscription. But yeah, irregular mailing lists where you suddenly need to tell your million users that your database has been breached and they need to change their passwords will be an issue.

But we are talking about $0.0005 (0.05 cents) worth of hashing on CPU systems per email. With GPU based hashing it should be 50 times cheaper. If your team has 1 million customers, and can't afford the $10 to pay a GPU based hashing service to hash 1 million emails for you, you might have a bigger problem.

I suspect the biggest issue for such a scheme is $10 for 1 million emails is potentially still profitable for spammers while being at the limit of how much cpu time you can expect to waste for regular (particularly mobile) users. And that's before you consider the possibility of ASIC hashing for emails.

Re:Google has most of my email because it has all of yours (... by dragonfray on Thursday September 17, 2015 @12:01AM (#10231512)
monetary costs can never be imposed on spammers, if we can move money on that scale along with email we've solved bigger problems!

what other costs can we impose? the email lists that spammers harvest stay valid for a long long time, what if they were invalidated faster? to have a high hitrate on their lists they'd need Google scale crawling capabilities, which kinda then defeats their point of trying to make a living from spam.

why are we converting long term relationships with servers(email id and password to login) into relationships with every Tom on the Internet(no control over who can reach you, hence you are in a relationship whether you like it or not)? Do we still have to remember emails or phone numbers, aren't they names in an address book already? why don't we just move off email, use a new system that uses long, hidden alphanumeric ids to identify relationships between people that can be invalidated by either party?

invalidate unnecessary relationships faster = invalidate spammer lists faster :)