This is, in fact, what I did when I switched to Fastmail. Others looking for absolute security over convenience have gravitated towards ProtonMail. I also discovered other perks to having a paid email service... like getting customer support.