The hardest part about switching from Gmail is simply the time it takes to migrate all your accounts over to the new address.

Some providers offer a switching service though.

My three email providers don't (Kolab, Posteo, Autistici) but the few hours I spent changing my email addresses everywhere was worth it.

Gmail really doesn't offer anything you'll miss once you make the switch.