Basically you don't control who gets to send you mails. You're entirely at Google's uncompromising and unreachable mercy.
DKIM is signing your email with the public key in DNS.
SPF is whitelisting which mail servers send mail from your domain
DMARC is how receiving ends should report how your mail is delivered (or not).
Unless you're actively spamming (ahem, "marketing") to large volumes of users, you should have no trouble at all getting mail delivered to users.
If you are doing mass email marketing, stick with your core competence and let someone else handle the mail servers.
After fifteen years running my own mail systems, I have finally given up. Ever more outgoing mail was getting lost, despite everything being up to date and done by the book. The arch villains, over and over, were Gmail and the MS thing - Hotmail, outlook.com, Live, whatever they call it.
Same here. I've been hosting my own e-mail for two decades (as of this year) and I gave up earlier this year. My spouse's e-mail to friends who use GMail--something like 80% of them--would, every couple of months, disappear into the recipient's spam folder or sometimes just disappear entirely. My logs would show a successful delivery but the recipient couldn't find the message anywhere. Occasionally messages would start going into junk in the middle of a conversation.
Nothing I changed would permanently fix it. I'd send from a different IP in my block (something.something.194 instead of something.something.193) and mail would flow again...for a couple of months and then stop. My domain registration predates Google's existence by 18 months. I've been sending from the same IP subnet for six years. My colo provider is actually so small that I'm the only customer left on my "neighborhood" /24 (they've recently asked me if I want the entire block routed to me for the lulz). I have SPF, DKIM, and DMARC all set up and they've not changed for at least two years. The amount of mail outbound from my server is (was?) so little that I could tail the outbound mail log and keep up with each message being sent.
None of that mattered. I even signed up for Google's Postmaster Tools but, and this really cooked my goose, I send so little e-mail that I don't qualify to show up on their reports. I tried contacting Google but hahahahahahahahahahahaha--wheeze--hahahahahahahaha.
No other recipient had a problem with me. Messages were successfully delivered to Microsoft and Yahoo just fine. Only Google had a problem with my e-mail.
I finally caved. Google has SO MUCH of the e-mail market that unreachability to them is a catastrophe...and they know it. I don't have the leverage to make them play nice.
Thankfully, Fastmail does so I've changed to them. For the first time since February 1997 my MX doesn't point to my own server and that makes me a little sad.
Here's some background https://wiki.list.org/DEV/DKIM
However, even that can only carry you so far. Gmail is screwed up in how they handle reputation, especially with regard to IPv6. The exact same message delivered to Gmail via IPv6 will get refused versus sending it via IPv4 will work fine.
This problem has existed for years. There are even standard hacks for postfix to cause all mail addressed to Gmail to be sent via IPv4 only, just to avoid this problem.
And any domain hosted with GAFYD is likewise screwed.
You can't know what your false positive stats are, because you don't have access to all the remote SMTP spools or logs on the 'net. All you can know for sure is the false positives that you find out about. But you literally have no way to tell how big the iceberg is under the water.
Aren't DMARC reports supposed to tell you that, especially ruf?
I only ask because I don't recall any problems over the years with one to one emails either to my gmail or from me to other people's gmail accounts.
There is a reason. It makes people switch from own email servers to gmail.
Do you have an idea what's triggering the false positives – keywords, IP reputation, etc?
The overall rate relative to my total e-mail volume is quite low, but it's enough that I have to check far more often than I'd like.
It wouldn't be a problem if I had a reliable way of whitelisting addresses, but none of the methods seems to be consistently reliable.
Note: We recommend that you do not mark your Spam/Junk Mail folder to
automatically learn "As spam". This can create a false positive feedback loop.
Imagine an email is incorrectly classified as spam, put in your Spam/Junk Mail
folder, and then learned as spam. That means future emails that aren't spam are
now more likely to be incorrectly marked as spam, sent to your Spam/Junk Mail
folder, and learned as spam. Only mark folders to learn "As spam" if they're
folders you manually move email to.
Now on top of that say you're using a MUA and its own spam filter runs atop of that, and decides to move a couple of legit stuff to Gmail's spam folder, triggering the server-side spam learning process. Surefire way to screw the whole thing up (happened).[0]: https://www.fastmail.com/help/receive/stopspam.html?u=b83140...
I've found the never mark as spam filter option to be reliable – amusingly I've also had the problem with Gmail flagging the Google Groups spam reports as spam, and this halted that.
So I have to constantly login to their site only to check the spam-folder (talk about convenience). I've setup rules to try to do my best to NEVER send anything to the spam folder but even with catch-all rules gmail still think they know better than me.
Their support for real (external) mail clients is also quite bad, I don't see why so many people in tech use gmail.
One other thing that I kinda sorta like in GMail is labels (as opposed to folders). As I understand, it's not a popular feature, because there's no reliable way to map it to IMAP? So anything that assumes that IMAP (rather than a custom client or web app) will be used as a mail reader, will probably only provide folders.
I have absolutely no problem with Fastmail's spam filtering. Maybe Gmail changed things since I switched, around 3-4 years ago, but with both, I used to get 0-1 spam emails per month, though I haven't gotten any on FM in the last few months.
I remember when people thought spam was single handedly going to make email unusable.