News for hackers. Stuff that matters.
Re:Running your own email is increasingly an artisanal choic... by jacquesm on Friday December 24, 2021 @08:19AM (#29673328)
Except of course that it isn't an artisanal choice, a very practical one that is made increasingly impossible by the few very large email providers that are left. It should be as simple as hosting a web server.

Speaking of which, how long before it won't be possible to host your own web server?

On another note: the biggest source of spam is gmail itself, and guess what, that makes it to my inbox just fine, because what could possibly be wrong with someone using google as their source. Spam was annoying but it was never an actual problem. The consolidation of the internet into a handful of players is a problem.

Re:Running your own email is increasingly an artisanal choic... by alufers on Friday December 24, 2021 @09:20AM (#29673777)
> Speaking of which, how long before it won't be possible to host your own web server?

It's increasingly getting harder and harder. Recently I was trying to watch a TV show with my friends using a self-hosted Plex server, which was located in one of my friend's house, connected via a gigabit, albeit residential link. Another friend was using LTE internet at that time. He couldn't watch the show, because his connection was so slow, but when he did a speed test the download speed was good enough (100+ Mbit).

Turns out the mobile carrier was throttling connections to select IP ranges to about 1 Mbit (we tested that with a few other IPs). I reckon it was to cripple peer-to-peer protocols. So I guess it's a matter of time until you will be allowed only to connect to certain IP addresses owned by the biggest companies (AWS, Azure, GCP) and nothing else.

Re:Running your own email is increasingly an artisanal choic... by velcrovan on Friday December 24, 2021 @11:40AM (#29675016)
Why net neutrality would have been nice, exhibit 78
Re:Running your own email is increasingly an artisanal choic... by kortilla on Friday December 24, 2021 @01:14PM (#29676085)
Net neutrality wouldn’t fix this is if the issue is a peering problem (which is very common today). The internet has become so centralized that ISPs cheap out on transit and just direct peer to all of the big content providers.
Re:Running your own email is increasingly an artisanal choic... by heartbeats on Friday December 24, 2021 @06:27PM (#29678787)
If your peering is that poor, how are you not failing to uphold your end of the contract?
Re:Running your own email is increasingly an artisanal choic... by LinuxBender on Friday December 24, 2021 @10:06AM (#29674155)
Speaking of which, how long before it won't be possible to host your own web server?

Maybe its just a matter of time for some. For me personally, I could not possibly care less if all the free mail providers blocked me some day. If something is important I can call people and tell them to go to https://mydomain.tld/theirName/ to grab files. I have used this method with non technical people including lawyers without issue. They prefer of course to use their own secure portals. I do acknowledge that running my own mail server may get more expensive with time as I may have to use providers that and more vigilant about keeping abusers off their network.

As for web servers why would I not be able to run my own servers? I can rent VM's, physical servers, racks, cages.

I am just speaking for myself but I will never give in to the bully anti-competitive behavior of the likes of Google and as for ISP's I will not use one that blocks ports or protocols. If there is any blocking to be done it must be done by me. I would never fund an ISP that uses CG-NAT or rate limits something by protocol or port. I realize some people have limited options but at least in terms of blocking and rate limiting, those ISP's are shooting themselves in the feet given that providers like Starlink and various 5G providers will be more common place soon.

Re:Running your own email is increasingly an artisanal choic... by emteycz on Friday December 24, 2021 @11:29AM (#29674904)
GSuite and Office 365 are not free, and make security guarantees to their customers.
Re:Running your own email is increasingly an artisanal choic... by tdrdt on Friday December 24, 2021 @08:54AM (#29673577)
"Except of course that it isn't an artisanal choice, a very practical one that is made increasingly impossible by the few very large email providers that are left. It should be as simple as hosting a web server."

I don't get this one. How do large email providers make it difficult to host your own email?

I host my own email. It was a pain to setup so I try not to touch it since it is running fine. Setting up email on your own server is just complicated unless you install server management software. I am not sure big email providers are to blame for this.

Re:Running your own email is increasingly an artisanal choic... by jacquesm on Friday December 24, 2021 @09:03AM (#29673639)
> How do large email providers make it difficult to host your own email?

By randomly marking your email as spam without any recourse. This may be because they blacklist your provider en bloc, your IP address or some subnet, because they feel like it, it's Tuesday or because their spam filters suck.

But it happens and it happens often enough that running a business in that way will cost you money, sometimes lots of it.

Re:Running your own email is increasingly an artisanal choic... by rsync on Friday December 24, 2021 @03:26PM (#29677399)
"By randomly marking your email as spam without any recourse."

Correct.

I'd like to describe how badly this is implemented:

I run my own mail server and I have a 15+ year history of emailing (mywife)@gmail.com.

On a regular basis (mywife)@gmail.com will email me, and I will respond to her email and my response will go to her junk/spam folder.

And there is no alert, no bounce, no notification.

Let's unpack this:

Google (gmail) knows that these two email addresses converse back and forth, regularly, with a 15+ year history. Google knows that their own user initiated this conversation. Google knows my email is a response to their users email. Google knows my address has never been marked as spam/junk.

So, what kind of unimaginably bad heuristics would have to be in employ to allow this to happen ?

To be honest, this wouldn't bother me that much - I don't think google owes me anything and my wife doesn't pay for their service. What makes me so, so angry is that they behave this way without any notification or bounce email.

That's just shitty.

Re:Running your own email is increasingly an artisanal choic... by jacquesm on Friday December 24, 2021 @04:40PM (#29678007)
Same here. And I can't even forward mail from one inbox to another because it invariably gets marked as spam. Two mailboxes, same browser, same IP.
Re:Running your own email is increasingly an artisanal choic... by smt88 on Saturday December 25, 2021 @06:01AM (#29682223)
> unimaginably bad heuristics

This is every Google product in a nutshell for me. Their "algorithms" are absurdly bad in every category.

Re:Running your own email is increasingly an artisanal choic... by Retric on Friday December 24, 2021 @09:19AM (#29673772)
Business use of email tends to look a lot like spam and people mark it as such. An appointment reminder or notification that something just shipped is generally fine. Send out mass notification of your holiday sales and that’s going into someone’s spam folder.
Re:Running your own email is increasingly an artisanal choic... by monsieurbanana on Friday December 24, 2021 @09:24AM (#29673803)
> generally fine

So you're saying that anything can get you blacklisted if you're unlucky enough? I think that's the point of the people you're arguing with.

At this point we just need to figure exactly how unlucky.

Re:Running your own email is increasingly an artisanal choic... by Retric on Friday December 24, 2021 @09:29AM (#29673844)
Not so much a question of luck, sending out sipping notifications that for example include advertising is risky. Sending a high volume of appointment reminders for the same appointment is similarly problematic.
Re:Running your own email is increasingly an artisanal choic... by jacquesm on Friday December 24, 2021 @09:31AM (#29673862)
I've never done any of that.
Re:Running your own email is increasingly an artisanal choic... by Retric on Friday December 24, 2021 @09:47AM (#29673990)
I don’t mean that’s the only way to trip up, there are a lot of unspoken self hosing email rules. Don’t use public data centers, don’t send news letters etc.
Re:Running your own email is increasingly an artisanal choic... by feanaro on Friday December 24, 2021 @10:04AM (#29674137)
My email server is only used as a personal server for a few select friends and family. They absolutely do not send and have never sent anything that could remotely be considered spam. Everything in our setup is picture perfect (SPF, DKIM, DMARC, PTR records, etc). We still can't get email onto Microsoft's servers without it being marked as spam.
Re:Running your own email is increasingly an artisanal choic... by Retric on Friday December 24, 2021 @06:28PM (#29678795)
Interesting, marked as spam in peoples inbox is different from simply never showing up which is what happens to the vast majority of spam.
Re:Running your own email is increasingly an artisanal choic... by feanaro on Friday December 24, 2021 @10:01AM (#29674118)
See the Digital Markets Act in the EU. It could be a way to force large corporations to cooperate.
Re:Running your own email is increasingly an artisanal choic... by emteycz on Friday December 24, 2021 @11:31AM (#29674923)
While completely abandoning hope for the small players in the process.
Re:Running your own email is increasingly an artisanal choic... by feanaro on Friday December 24, 2021 @06:22PM (#29678759)
Could you expand? Abandoning hope in what way?
Re:Running your own email is increasingly an artisanal choic... by Nasrudith on Saturday December 25, 2021 @06:09PM (#29687911)
You are still hosting it fine. They just decide that you or your messages are suspect.

Also one thing - if people actually want your email they will contact you if they don't get an expected email. If they don't want your messages it is spam.

Re:Running your own email is increasingly an artisanal choic... by hamilyon2 on Friday December 24, 2021 @09:24AM (#29673802)
Even if your ip address/domain is not in the blacklist right now, it only takes a few people marking your correspondence as spam for it to be blacklisted. Since everyone is on these big free providers, nobody will ever see a single email from you any more. With less centrally controlled email, that would not be possible. I think that is the problem everyone is talking about.
Re:Running your own email is increasingly an artisanal choic... by grishka on Friday December 24, 2021 @09:46AM (#29673988)
People generally know to check their spam folder if they're waiting for an email but it doesn't arrive.
Re:Running your own email is increasingly an artisanal choic... by kiwijamo on Friday December 24, 2021 @05:44PM (#29678492)
I generally don't check my personal spam folder. I've honestly not seen any false positives with Fastmail. But I certainly do have to check every now and then for my work O365 account which is pretty bad at marking legitimate mail as spam. YMMV of course.
Re:Running your own email is increasingly an artisanal choic... by vetinari on Friday December 24, 2021 @09:49AM (#29674018)
> How do large email providers make it difficult to host your own email?

By not delivering mail sent by your mailserver to mailboxes hosted by them. There's not much use for an own server, if your mail won't be received by most users on gmail or hotmail.

Re:Running your own email is increasingly an artisanal choic... by Kwpolska on Friday December 24, 2021 @09:06AM (#29673665)
The problem with e-mail, and with other forms of communication, is that two parties (or their service providers) need to co-operate. You can run your own e-mail server just fine, but Google, Microsoft and friends might consider you to be a spammer or silently block your e-mail just because.
Re:Running your own email is increasingly an artisanal choic... by indigochill on Friday December 24, 2021 @09:55AM (#29674070)
What if email was based on a whitelist instead of a blacklist? So you'd only receive email from addresses of people you've already established contact with some other way (maybe using conventional email)? This eliminates spam and if the big providers supported this, it could also enable them to stop blackholing innocent servers (though whether they care is another question).
Re:Running your own email is increasingly an artisanal choic... by teekert on Friday December 24, 2021 @09:59AM (#29674109)
You'll get it when Microsoft decides you are a spammer for no other reason then sending email from port 25 from your house. Or when you can't seem to sign up for a service... until you use your old Gmail address.
Re:Running your own email is increasingly an artisanal choic... by matt_heimer on Friday December 24, 2021 @10:53AM (#29674572)
Yeah, there was (is?) a period of time where viruses were used to send spam so if you got infected you'd suddenly be sending out a lot of SMTP traffic from a residential IP address. The entire industry adopted the practice of not trusting residential ips. Then the spammers shifted to cheap VPS providers and ip and netblock black lists became more common.
Re:Running your own email is increasingly an artisanal choic... by pjc50 on Friday December 24, 2021 @09:08AM (#29673683)
> biggest source of spam is gmail itself

[citation needed]; is this actually going out from gmail or does it just use gmail return addresses?

I too used to run my own email from about 2000-2010, but the maintenance overhead is quite stressful especially because it always happens for critical times or critical emails.

Re:Running your own email is increasingly an artisanal choic... by ancarda on Friday December 24, 2021 @09:21AM (#29673785)
Almost all spam I receive is from Gmail. It's gotten so bad I've actually setup a filter that routes everything from @gmail.com into spam - except for some whitelisted email addresses. G Suite is fine, it's only @gmail.com that is an issue

And yes, it's genuinely from Gmail; valid SPF, valid DKIM, came from a Google IP address, etc...

To say the biggest source is Gmail might be technically wrong though - I suspect there's a large volume of spam that Migadu (my provider) is dropping before it even reaches my inbox, i.e. emails that it is 100% sure are spam and it can just drop. Nevertheless, an overwhelming amount of spam I observe/have to deal with is coming from Gmail. Second to that is outlook/hotmail.

Re:Running your own email is increasingly an artisanal choic... by zkldi on Friday December 24, 2021 @11:40AM (#29675018)
> To say the biggest source is Gmail might be technically wrong though - I suspect there's a large volume of spam that Migadu (my provider) is dropping before it even reaches my inbox, i.e. emails that it is 100% sure are spam and it can just drop. Nevertheless, an overwhelming amount of spam I observe/have to deal with is coming from Gmail. Second to that is outlook/hotmail.

This. It's more likely to be survivorship bias -- the gmail emails happen to survive because gmail is more trusted.

Re:Running your own email is increasingly an artisanal choic... by Lex-2008 on Friday December 24, 2021 @11:36AM (#29674971)
Re: [citation needed];

> Gmail obvious spam still #1 in the quarantine folders..

-- Michael Peddemors, President/CEO LinuxMagic Inc.

https://www.mail-archive.com/[email protected]/msg14526.html

Re:Running your own email is increasingly an artisanal choic... by jacquesm on Friday December 24, 2021 @09:12AM (#29673719)
The citation you are looking for is my inbox. That's the spam that still makes it through and there is quite a bit of it, conversely some ham consistently gets misclassified as spam or just simply disappears entirely.

You are of course welcome to not believe me.

Re:Running your own email is increasingly an artisanal choic... by tpxl on Friday December 24, 2021 @09:20AM (#29673779)
I will echo this experience. An example of an email that made it through from a gmail.com account (abbreviated, it also contained links to some apps (the main purpose I assume) and much more text):

شهر مجاني عند الاشتراك السنوي $ الأسئلة الشائعة

    In 1979, LA residents were wearing masks — because of smog Los Angeles Times staff photographer Boris Yaro photographed Sera Segal-Alsberg on Crescent Heights Boulevard in West Hollywood Segal-Alsberg, an artist-instructor, was en route to teach a class at the Los Angeles County Museum of Art
    للمزيد من الأسئلة

    — In another sign of live entertainment’s rebirth, Bruce Springsteen returned to Broadway over the weekend
    يقوم الموظفين بتسجيل حضورهم ، انصرافهم الشركات العصرية مع الاستفادة القصوى من الإمكانيات الهائلة التي تقدمها لنا تكنولوجيا العصر أو الهاتف المتحرك ( الجوال ) أو إذا كنت تستخدم الحاسب فيمكنك استخدام أو يمكن للإداري تحميل هذا التطبيق على جهاز تابلت اشترك في النظام 10

    Diverse yet divided cities
    واحد أو عدة أجهزة ثم يضعها اشترك في النظام تسجيل دخول فقط في الأفرع المسموح له بالتبصيم فيها  |  أسبوعين كما أن الموظف لديك يستطيع التبصيم في ثوان قليلة بريد إلكتروني هو نظام إلكتروني قوي وحديث يستخدم لتسجيل فهل يمكن استخدام النظام في جميع هذه الأفرع أدخل بيانات الأفرع إن وجدت الموظفين

    Experts say the Delta variant poses a greater chance of infection for unvaccinated people if they are exposed The variant, first identified in India, may be twice as transmissible as the conventional coronavirus strains It has been responsible for the rise in cases recently in India, the United Kingdom and elsewhere
    في مداخل الشركة أو أفرعها المختلفة يمكنك الاعتماد على أي جهاز إلكتورني حديث أو حتى قديم في تسجيل ومتابعة تبصيمات الموظفين ، إعرف المزيد اشترك في النظام مجانا , أدخل بيانات الشركة والموظفين
Re:Running your own email is increasingly an artisanal choic... by kiwijamo on Friday December 24, 2021 @05:50PM (#29678548)
When I ran my own mail server some years ago I was shocked at the amount of spam originating from Google. Definitely their IP addresses as I would routinely get other legitimite mail from the same IP ranges. Was quite a challenge dealing with these spam as it wasn't as simple as blocking their ip ranges as the vast majority of my personal contacts use Google. Never saw the same from Microsoft, Apple, etc.
Re:Running your own email is increasingly an artisanal choic... by Anadorr on Friday December 24, 2021 @10:32AM (#29674382)
There's quite a lot of small providers left and thriving - I've recently migrated from Gmail to mailbox.org, set up inbox encryption with my own key and can't be happier about it.

It's not as feature-rich as Gmail, and webmail with your own encryption key is not usable, but desktop (Thunderbird) and mobile (K9 mail) clients fully cover my use cases. Cheaper than Google Workspace, too.