News for hackers. Stuff that matters.
Re:JMAP: Like IMAP but Not Really by ggm on Friday January 25, 2019 @04:18AM (#18996659)
The main failure in mail standards is a lack of explicit utf8 clean support lhs@rhs -if this got fixed (it's often called universal acceptance) a lot of things about mail as an ecology would improve.

I have view on the spam thing. The whole "your idea will not work because" meme is hugely destructive of innovation in email. It sucks energy and mindshare. It's classic old timer put down.

What would (imnsho opinion) have fixed spam is sender pays. I've debated this with a lot of people. We're 50/50 on it. Fifty agree with me, fifty million don't.

Jmap is utf8 clean btw.

(I used to do email for a living in the eighties when life was simple and bang!chains!worked)

Re:JMAP: Like IMAP but Not Really by majewsky on Friday January 25, 2019 @07:42AM (#18997428)
> What would (imnsho opinion) have fixed spam is sender pays. I've debated this with a lot of people. We're 50/50 on it. Fifty agree with me, fifty million don't.

I propose a scheme where the sender pays e.g. 5 ct per e-mail (low enough that it does not matter for legitimate use, but high enough to make spam unprofitable). BUT with the following twist: The receiver can generate API tokens that allow free e-mail delivery.

So when I sign up for e.g. Twitter, I can give them an API token for my mail address so they can send notification mails to me for free. If they decide to start spamming me, or if they decide to sell my token to a spammer, I can just revoke the token and the spam flood stops instantly.

I have not found any flaws in this idea yet. RFC!

Re:JMAP: Like IMAP but Not Really by pbhjpbhj on Friday January 25, 2019 @08:51AM (#18997825)
First thought is that international differences in value of a fixed monetary amount might break it. 5¢ is affordable in USA but too much in, I don't know, Mongolia. Lower it to 0.05¢ and you get spam from USA.

Natural solution is a pricing list, but then USA spammers could route via cheapest geographic servers.

How do you get paid? Banks will put a transaction cost making sending email cost stupid money. So, bitcoin? But the built in energy costs for processing a transaction will force a floor on the transaction pricing that's too high?

If a token leaks you'll have to fiddle about to allow a sender's emails to get through ; I guess you could automate that if your MUA had credentials to inform genuine senders of API key updates.

Re:JMAP: Like IMAP but Not Really by cujo on Friday January 25, 2019 @09:48AM (#18998306)
You could do away with the 5ct part of this, just by requiring a special header to get around the api part.

Then you funnel all that junk into a special folder (black hole) that you can either ignore or check if you are expecting a legit request for your attention.

The more I think about it, the more I love this idea. All email that shows up in your inbox is there because you have to explicitly allowed it.

Re:JMAP: Like IMAP but Not Really by dane-pgp on Friday January 25, 2019 @03:22PM (#19002128)
I've been thinking of a similar system, actually, but instead of having each end user pay per transaction, you have each domain put up a bond (in a digital currency) which can be forfeited if the domain is found guilty of spamming.

The one controversial part of this is deciding who is permitted to redeem the bond, i.e. who is the central arbiter of what is and isn't spam? Well, fortunately we already have an entity like that, de facto, since we have the Big 4 email providers ("Gmail, Hotmail, Yahoo, and AOL", or any other similar group that all mail servers must, in practice, comply with the demands of).

In the system I'm proposing, if any of these big providers detect a domain being involved in spam (or N out of M providers, to reduce the risk of false positives), they could redeem the bond. Of course, the bond would be structured such that the only recipient was a non-profit, like the IETF, or possibly an entity like ICANN. That way there is no financial incentive to make false positive claims.

As for how this system would be introduced, that's the easy part. All pre-existing domains would be grandfathered in, so that no current email users would be negatively affected. (Indeed, there is a moral hazard that some email providers would support this system precisely because it only affects new entrants to the market). There would simply be a flag day, after which if you register a new domain, and want to send emails from it, your domain registrar would have a check box saying "Yes, I am happy to be charged an extra $10 and have put it in a bond so that I can send email to the Big 4 providers". After sending a certain amount of legitimate email, a Big 4 provider could then send a transaction which makes the locked funds return to the original issuer of the bond.

Finally, to decide how big the bond has to be, we can look at data like this:

https://krebsonsecurity.com/2018/06/bad-men-at-work-please-d...

If spammers are going to extra effort to save a few dollars on their registration costs, then their margins must be pretty tight. It also means that domain reputation systems are working, since spammers have to keep bulk buying new domains:

http://conferences.sigcomm.org/imc/2013/papers/imc247-haoA.p...

Re:JMAP: Like IMAP but Not Really by efdee on Friday January 25, 2019 @04:37AM (#18996726)
If paying to send email is your suggested solution, I can see why you don't like the meme in question. But the suggestion is rife with problems. How exactly are you going to get everyone to start paying for email, which is free today? If it's a parallel system, how are you going to get people to switch? Who are they going to pay?
Re:JMAP: Like IMAP but Not Really by tonyedgecombe on Friday January 25, 2019 @05:25AM (#18996907)
If people received credit for incoming mail then the majority wouldn't get a bill as most people receive more than they send.
Re:JMAP: Like IMAP but Not Really by thekyle on Friday January 25, 2019 @08:37AM (#18997734)
As an alternative but similar idea, Proof of Work was originally developed to solve the email spam problem. The idea was that you would hash the email body + timestamp + nonce producing a hash with some number of leading zeros. It would be fast for individual devices to compute and fast for email servers to verify en mass but expensive if you needed to send lots of emails.

The obvious downside is that since the system is fundamentally just cryptography it doesn't discriminate between spam and legitimate bulk mail (password resets, newsletters, mailing lists, etc.)

Re:JMAP: Like IMAP but Not Really by bjoli on Friday January 25, 2019 @05:32AM (#18996939)
Most bigger services are probably going to send and receive about the same amount of mail so it will be an almost zero-sum game. Most services today have a cap on how mail you can send, and this could be made more explicit and have cases where the end user actually pay.

I don't really see the payment as a big problem. This has been discussed previously, mostly initiated by the big email services

Re:JMAP: Like IMAP but Not Really by mathnmusic on Friday January 25, 2019 @05:26AM (#18996913)
> Who are they going to pay?

The sender pays the reader. If the reader is the one deriving the value from this communication, they would pay the sender out of band as compensation.

Re:JMAP: Like IMAP but Not Really by detaro on Friday January 25, 2019 @05:28AM (#18996919)
So what does a reliable, not centralized payment system that is viable for this volume of tiny transactions that everyone can use look like? That's IMHO the big problem with all these suggestions.
Re:JMAP: Like IMAP but Not Really by oarsinsync on Friday January 25, 2019 @04:42AM (#18996749)
> What would (imnsho opinion) have fixed spam is sender pays. I've debated this with a lot of people. We're 50/50 on it. Fifty agree with me, fifty million don't.

Along with the billions of spam SMS that are also supposed to be sender-pays, sadly

Re:JMAP: Like IMAP but Not Really by distances on Friday January 25, 2019 @09:21AM (#18998041)
Is this in the US? I've had SIM cards in three European countries, never received a spam SMS.
Re:JMAP: Like IMAP but Not Really by oarsinsync on Friday January 25, 2019 @10:31AM (#18998755)
I've experienced this primarily in two European countries, as well as the Americas (both north and south) and east Asia.
Re:JMAP: Like IMAP but Not Really by zimpenfish on Friday January 25, 2019 @06:30AM (#18997150)
> What would (imnsho opinion) have fixed spam is sender pays.

Alternate but similar - sender holds the email until the receiver fetches: https://cr.yp.to/im2000.html

I'm not sure it actually helps that much to cut down spam but anything is worth a try at this point.

Re:JMAP: Like IMAP but Not Really by mnw21cam on Friday January 25, 2019 @09:35AM (#18998163)
That sounds like a nice way to allow the sender to work out whether the receiver mailbox is active.
Re:JMAP: Like IMAP but Not Really by zimpenfish on Friday January 25, 2019 @10:57AM (#18999023)
That assumes there's no facility for batching - where my server can ask a remote server "give me everything for <mydomain>" rather than asking for each individual mail.
Re:JMAP: Like IMAP but Not Really by m_mueller on Friday January 25, 2019 @04:35AM (#18996718)
How about a combination of sender-pays and a whitelist for everyone else? Essentially, have a web-standard for what linkedin is doing.
Re:JMAP: Like IMAP but Not Really by jeltz on Friday January 25, 2019 @10:03AM (#18998491)
Paying might reduce the spam, but some spammers are perfectly fine with paying. Just look at text spam and robocallers.
Re:JMAP: Like IMAP but Not Really by c22 on Friday January 25, 2019 @07:43AM (#18997434)
Sender pays to stuff junk in my physical mailbox and I have a lot more trouble with spam there than I do in my email.
Re:JMAP: Like IMAP but Not Really by gsich on Friday January 25, 2019 @04:42AM (#18996754)
You could pay with computing power.

https://en.m.wikipedia.org/wiki/Hashcash

Re:JMAP: Like IMAP but Not Really by giornogiovanna on Friday January 25, 2019 @05:49AM (#18996998)
The standard response to proof-of-work spam deterrents is that "significant numbers of senders of legitimate email would be unable to continue their current levels of activity"[0]. While I don't think that's necessarily a bad thing, it does limit the utility of such a service.

[0]: https://www.cl.cam.ac.uk/~rnc1/proofwork.pdf

Re:JMAP: Like IMAP but Not Really by chriswarbo on Friday January 25, 2019 @06:37AM (#18997177)
As I see it, hashcash could be a good idea if there's a standard way for the receiver to tell the sender how much hashcash they need to include.

Email is designed around asynchronous clients, e.g. the ability to write everything offline, connect for just long enough to queue them all up in some server, then disconnect while that server passes them along. By the time the receiver (server or client) knows that they've been sent a message, the sender may be long gone.

Hashcash only works if:

- It can't be bypassed. Without a mechanism to tell senders how much to include, receivers must set their price near zero to avoid discarding legitimate messages which guessed the wrong amount. Keeping messages without any/enough hashcash would defeat the purpose of the thing.

- The sending client does the work. Since servers are always online and reachable via a known address, we could have them negotiate an amount; e.g. the receiving server checks the message for hashcash, returns an error stating that a certain amount is required, the sending server tries again with more hashcash. The problem is, getting the sending server to mine hashcash won't stop spammers: they'll just use other people's servers, like gmail, hotmail, etc.

I've written about this before, but I think that a generic protocol for negotiating hashcash would be really worthwhile. Maybe it could be made to work for email, but even if not there are plenty of synchronous protocols which could use it.

In particular, there's no reason to keep a fixed price; we can figure out a price using the same heuristics as existing spam filters: can we verify the sender, have we seen spam/ham from them before, do they appear on black/whitelists, etc. This way the pressure can be kept on spammers, whilst the majority of normal traffic can go through with little effort. Note that this fixes the mailing list problem too, e.g. if users add the list address to their whitelist, or if they send a message in order to subscribe (hence triggering the "allow this, it's a reply to our message" heuristic).

I also think this would be a nice alternative to API keys, since it would keep things more "open" for experimenting and mashups, whilst giving providers a way to avoid abuse (API keys could still be provided, as a way to significantly lower the amount of hashcash required).

Re:JMAP: Like IMAP but Not Really by hombre_fatal on Friday January 25, 2019 @08:07AM (#18997559)
It seems like a good idea until you realize spammers, like DDoSers, aren't using their own machines.

The idea was dead on arrival.

Re:JMAP: Like IMAP but Not Really by gsich on Friday January 25, 2019 @02:48PM (#19001755)
Then you might at least notice some CPU usage.
Re:JMAP: Like IMAP but Not Really by bjoli on Friday January 25, 2019 @05:42AM (#18996973)
I don't see why you are getting downvoted. Proof of work is a great way to limit spam. It could be made almost unnoticeable by the end user sending a couple of messages, but expensive for spam. There are of course some show stoppers (mailing list, non-profits etc), but it is not a bad solution.
Re:JMAP: Like IMAP but Not Really by jannes on Friday January 25, 2019 @04:45AM (#18996765)
That's horrible for the environment.
Re:JMAP: Like IMAP but Not Really by bjoli on Friday January 25, 2019 @05:43AM (#18996977)
Depending on the workload it will be a marginal load, and getting rid of spam would be a pretty big gain.
Re:JMAP: Like IMAP but Not Really by gsich on Friday January 25, 2019 @04:51AM (#18996788)
Filtering spam mail is too - what's your argument?
Re:JMAP: Like IMAP but Not Really by 05 on Friday January 25, 2019 @05:05AM (#18996837)
So, send ten emails and your smartphone battery is dead?