> unless you setup your own SMTP server (probably not a good idea), you never really have full control

Why does it matter? You're not storing data on that server or anything, so the cost to leave is negligible.