Connect the devices all together with wifi direct to share and mix audio. Then have whichever device is connected to the earbuds send the mixed stream. The extra bandwidth of 802.11 would also allow for additional latency on the order of milliseconds.