News for hackers. Stuff that matters.
Re:After self-hosting email for 23 years I have thrown in th... by leephillips on Thursday December 28, 2023 @12:48PM (#38796129)
This article exaggerates the problem. I’ve been hosting my own email for many years and I have almost zero deliverability obstacles. The advantages of running your own email server are huge.
Re:After self-hosting email for 23 years I have thrown in th... by baobabKoodaa on Thursday December 28, 2023 @01:20PM (#38796585)
> I’ve been hosting my own email for many years and I have almost zero deliverability obstacles.

This is almost certainly false. If this is not false, please do show how you measured your deliverability (across all those years) and how those measurements show "almost no" issues.

Re:After self-hosting email for 23 years I have thrown in th... by j6zauas4gz on Thursday December 28, 2023 @01:32PM (#38796771)
Not the person you are replying to, but I've been self hosting an email server for ~3 years (which is not that long tbh, so take this data point for what it is), and have similerly also had almost zero deliverability issues.

I can tell because I also run a mailman mailing list (~500 people) on that same server and domain, I measure initiall discoverability by how many bounces I get (almost always none) and also that the high percentage of read receipts I get, and the fact that engagement with the list is pretty even across domains (IE, people with gmail, outlook, yahoo, and aol emails all frequently read and engage with the list).

Re:After self-hosting email for 23 years I have thrown in th... by baobabKoodaa on Thursday December 28, 2023 @01:40PM (#38796872)
Interesting! Can you share the numbers for read receipts and "engagement" for different domains? I'm very surprised if the % for gmail and outlook truly is not lower than the % for yahoo and aol, as you indicated.
Re:After self-hosting email for 23 years I have thrown in th... by j6zauas4gz on Thursday December 28, 2023 @02:00PM (#38797133)
I'd have to do some digging since its been a while since I've sent out a newsletter (the only thing I use the tracking pixel on to check read recepts) but IIRC a little under half of the list pinged the server with the pixel . Which seems about right to me, esp given that some clients block tracking pixels.

> I'm very surprised if the % for gmail and outlook truly is not lower than the % for yahoo and aol, as you indicated.

the distribution of domains is far from even, but I can tell by checking my inbox from today that one of our most frequent posters with an aol domain sent a news article around and it started a thread with multiple gmail users chatting with the original poster about it.

Thats not hard numbers, but everyone on the list has agreed that the list works better on the self hosted server then it did on google groups.

Re:After self-hosting email for 23 years I have thrown in th... by baobabKoodaa on Thursday December 28, 2023 @02:08PM (#38797228)
> the distribution of domains is far from even

This might be indicative of deliverability issues affecting some domains only.

The fact that some gmail users can see emails doesn't mean 100% of gmail users are delivered your email.

Re:After self-hosting email for 23 years I have thrown in th... by j6zauas4gz on Thursday December 28, 2023 @02:27PM (#38797446)
> This might be indicative of deliverability issues affecting some domains only.

I mean maybe? I remember when we switched from google groups that I checked and the % of opens and that it seemed fairly evenly distributed given that the percentage of gmail users far outweighs the percentage of yahoo/aol users, and to be honest I've not bothered to check much more beyond that point. But the core group of crotchety old folks who frequently send round interesting local stories are a decent mix. The last couple of days I see 4 different gmail accounts, one work domain (that I assume is outlook but might be some other provider), the aforementioned aol account, and the burner riseup account that I use when I am feeling crotchety.

> The fact that some gmail users can see emails doesn't mean 100% of gmail users are delivered your email.

Sure, its possible but I've not seen any evidence of it after we made the transition. I've seen email sent from gmail accounts to gmail accounts not get delivered, expecting 100% is never going to be realistic even with the largest mail providers.

Unless and until I start getting in person complaints (which, trust me, I would if there was a problem) or see people mention emails going into spam, I'm going to keep on keeping on.

Re:After self-hosting email for 23 years I have thrown in th... by baobabKoodaa on Thursday December 28, 2023 @02:30PM (#38797496)
Can I sign up to your mailing list as a test?
Re:After self-hosting email for 23 years I have thrown in th... by alerighi on Thursday December 28, 2023 @01:40PM (#38796874)
It's not that difficult. I host my email server on an AWS machine (so the IP that gests out is clean), and all I had to do is to setup DKIM signature and create the SPF, DMARC and DKIM DNS records for the domains.

Setting all up is complex, but there are project that give all the tools in a Docker container. Since I wanted to learn it I did all manually, and did set up postifx, dovecot, opendkim, postfixadmin and even squirrelmail as a "retro" web interface, with a postgresql database to keep the mailboxes and the accounts. It was an interesting experience, plus now I have full control of the mail system, e.g. I can decide to route the mail in whatever directory just by changing the SQL query that decides in which mailbox a message should be delivered.

Re:After self-hosting email for 23 years I have thrown in th... by baobabKoodaa on Thursday December 28, 2023 @02:10PM (#38797255)
> It's not that difficult. I host my email server on an AWS machine (so the IP that gests out is clean), and all I had to do is to setup DKIM signature and create the SPF, DMARC and DKIM DNS records for the domains.

I personally did do all of that, and my emails didn't get delivered. I wrote about my experience in detail here: https://www.attejuvonen.fi/dont-send-email-from-your-own-ser...

Re:After self-hosting email for 23 years I have thrown in th... by alerighi on Thursday December 28, 2023 @06:40PM (#38800121)
The most important thing is to setup DKIM, SPF and DMARC correctly. I mean sign the emails with the correct key, but also setup the correct records, e.g. SPF record must be TXT, if you create a (deprecated) SPF type record GMail won't recognize it, even if you also have the TXT one! Of course they don't mention it in the documentation, and I've spent 1 month of trial and error to figure it out. And the DKIM record needs to be formatted exactly correctly (antother thing that took me time to figure it out)

With DMARC you can specify that the recipient sends you a periodc report of the delivery status, this is useful to debug eventual problems. For example GMail and Outlook send this out, and gives you information about the fact that your DMARC is working correctly and SPF and DKIM checks are passed.

Anyway when you manage to get it working, it did work for around 4 years without any issues. I've even reinstalled the mailserver to another machine (keeping the same IP) and I did not have any issue in the migration.

Re:After self-hosting email for 23 years I have thrown in th... by leephillips on Thursday December 28, 2023 @01:27PM (#38796691)
I almost certainly don’t care whether you believe me.
Re:After self-hosting email for 23 years I have thrown in th... by baobabKoodaa on Thursday December 28, 2023 @01:51PM (#38797038)
Ok, so you didn't actually measure your deliverability, so a portion of the emails you send are not being delivered, just like everyone else who self hosts email.
Re:After self-hosting email for 23 years I have thrown in th... by Sirizarry on Thursday December 28, 2023 @01:13PM (#38796479)
What are the practical advantages to owning your own email server and not using something like proton? Maybe I’m just not a heavy user of email but I’m struggling to find use cases that aren’t mostly ideological.
Re:After self-hosting email for 23 years I have thrown in th... by nulld3v on Thursday December 28, 2023 @01:32PM (#38796770)
- Another step up in security: ProtonMail can still read unencrypted incoming email. With self-hosting, you only have to trust your hosting provider.

- Better IMAP support: ProtonMail doesn't support IMAP without the ProtonMail bridge. The ProtonMail bridge was very buggy for me, and I have to self-host it anyways. With self-hosted email, I can just use IMAP normally (yay).

- Better email search: With ProtonMail you can search for keywords in the message body but it doesn't work if you have lots of mail. With self-hosting you can search however you like across as much mail as you like.

- Easier backups: On my self-hosted setup I can configure automated periodic backups. I don't think that's possible on ProtonMail.

- Cost: ProtonMail is really expensive :(

The main reason I switched was the IMAP part. I just got tired of the bridge bugs.

Re:After self-hosting email for 23 years I have thrown in th... by SoftTalker on Thursday December 28, 2023 @01:20PM (#38796584)
One less dependency that may suddenly change or vanish with little or no warning, causing you to drop your planned work and react to its whims.

Also if you're already paying for IP service, there is no technical reason you should have to pay an email provider. Email standards and software are all open and free.

Re:After self-hosting email for 23 years I have thrown in th... by detourdog on Thursday December 28, 2023 @01:28PM (#38796704)
Unlimited attachment size and storage. Ability to verify and document all steps of email delivery.
Re:After self-hosting email for 23 years I have thrown in th... by bell-cot on Thursday December 28, 2023 @01:35PM (#38796805)
Unless a message needs no other email service provider to be delivered, your attachment sizes are still subject to other providers' limits.

Yes, you can log the crap out of "$Server.$OtherProvider.$TLD accepted $MessageID for delivery" - but that doesn't stop $OtherProvider from failing to deliver it to the recipient's IN box.

Re:After self-hosting email for 23 years I have thrown in th... by detourdog on Thursday December 28, 2023 @09:40PM (#38801254)
True but not everyone limits email attachment sizes.
Re:After self-hosting email for 23 years I have thrown in th... by TheOtherHobbes on Thursday December 28, 2023 @01:22PM (#38796608)
As many addresses/aliases as you want on as many domains as you want.

Custom filtering/sorting.

Easy burner addresses.

Custom reader tracking for marketing.

Custom reader db response pattern mailouts/campaigns.

Some of these are Some Assembly Required, but they're hard/impossible/expensive to do with 3rd party mailers.

Re:After self-hosting email for 23 years I have thrown in th... by alerighi on Thursday December 28, 2023 @01:50PM (#38797016)
The reason why I host my own email service is that I can have a wildcard address, that no provider (that I know) offers. So that I can use whatever address@mydomain that I want, without creating an alias in the mail server.

For this reason I can have a different address for each service that I register with, for example facebook@domain, and thus easily block services that start spamming out, and even know if a service leaks my address without authorization.

Yes, I know that GMail has a similar feature (by using [email protected]) but some sites blocks it, and still you don't have that ability to have a completely different address, that if one day you want can become its own mailbox.

Another reason is that commercial email services started blocking the simple SMTP/IMAP authentication with username/password, making it difficult, if not impossible, to configure a server them to send email trough GMail or Outlook, or a service to subscribe trough IMAP subscription to the mailbox to trigger an action when a mail arrives. Proton even decided not to support plain SMTP/IMAP, and you need a bridge to use it!

All my systems, being them servers or services that run on them, are configured to send the email trough my server, and the configuration is super easy. So that, for example, I'm notified if a cron job fails (basically the mail to the local Linux users gets routed to my server) or I have my Home Assistant installation notify me trough email.

Next I manage different domains, and I can have all that domains in a single central mail server. That allows to manage the mail of different systems in a central place, and with a single account. As far as I know this is not possible with commercial services: what you can do is of course to have one system forward the mail to another, but to send the mail as another domain with the same mailbox? With my mailserver I can, I just configure multipe FROM addresses in Thunderbird.

Finally on my server I don't have a limit on the number of accounts/mailbox, so I create an account/mailbox for whatever reason I want in two seconds, for a fixed montly cost (of around 10 euros, since I use the smallest AWS EC2 that they have available)

As you see, there are plenty of reasons to have your own mail service.

And, and let's conclude with: I've lost more mails thanks to antispam in commercial email software such as Outlook or GMail, that on my own server. I don't care about spam, I (if needed) know how to filter it out client-side. I don't want systems to refuse or even hide messages to me, something GMail and Outlook does.

Re:After self-hosting email for 23 years I have thrown in th... by leephillips on Thursday December 28, 2023 @01:24PM (#38796641)
Mainly control. You can set your own policies, such as deciding which ban lists to use. I have a backup server in another continent. It’s far less likely to have my account deacitivated for a mysterious reason by (both) my hosting providers than some email hosting company. So I feel that my access to email is more assured. I can have an infinity of ad-hoc email addresses and set any routing, or run any program on the server, based on the recipient address.
Re:After self-hosting email for 23 years I have thrown in th... by doublerabbit on Thursday December 28, 2023 @01:21PM (#38796606)
For me, it's that all data that resides within the received email is mine. There's no outside force pre-scanning my receiving emails to display advertisements.

I can create as many alias, mailboxes I prefer.

Overall the freedom is soothing.

I to have never had emails denied but then again I'm using colocation based hosting, so my IP block is one that's never been used before.

Re:After self-hosting email for 23 years I have thrown in th... by adrian_b on Thursday December 28, 2023 @01:24PM (#38796656)
I have also hosting my e-mail server for the last twenty years.

I do not intend to ever give up on this.

I had problems in the past, mainly with Microsoft, but they were not insurmountable.

The worst problems with delivery have been a few years ago, I had less problems recently.