> Move to a small mail provider and hope they don't go under (and you lose your x year old email address associated with tons of stuff) or have security issues because they didn't/couldn't afford the expertise.

You can also just use an email client that downloads the emails you get, and then point your MX-records to another provider if and when your provider goes belly up.