This is exactly what I've done. I have one pair of $250 headphones I've had for years that I use when I want to sit in a dark room and just listen to music. Now the dongle lives on them and there is no inconvenience at all.