Thank you for all the suggestions, your answer is exactly what I was hoping for!

It sounds like Avantree DG80 might solve my issues on Linux, I never realized I could outsource the entire Bluetooth audio headache to a generic dongle and get regular audio out of it.