Use the nicer one for listening. Use the shittier one for conferences. It's not an Airpod thing, Bluetooth just sucks and doesn't support high fidelity full duplex audio.

Same issue on Macs for what it's worth. If you are listening to music and a meeting starts and the mic turns on, the protocol will switch and everything will sound like crap.