From my experience, this usually happens with the older/cheaper Android devices that use a combined BT+WiFi radio/chipset (Nexus 4, Galaxy S3 etc.)

Fortunately, the Android hardware is getting better and better, e.g. I've noticed no such problems on Nexus 5 or Galaxy Edge.