I have two devices I pair my AirPods with, one a work laptop and one a personal phone, using two different iCloud accounts. I also had the problems you describe.

I started disabling Bluetooth on my phone and now the AirPods don’t seem to have any issues. Not sure if it was related, but maybe worth trying.