I've tried this many times, but it doesn't ever seem to actually work. If my Mac is nearby, it immediately steals the pairing back, even if they're not the most recently selected audio device on the Mac.