Many email servers (e.g. gmail) won't even accept email from residential IPs. I have a janky setup where I proxy mail from my home network to my VPS and then send it from there (outbound-only, and only to myself - for notices like "backup started", "backup finished" etc)