I do find it annoying that you can't use voice typing on 3rd party keyboards, but I use gboard for swipe typing and then will switch to the oem keyboard when voice typing. It's not perfect (because the kb switch button doesn't usually go the keyboard I want), but it does work ok.

FWIW, voice typing generally works well for me. Not sure why you're having so much trouble.