"Tangential, but at some point of the last 15 years I thought the music industry might move to distributing what amounts to dedicated MP3 players/USB sticks"

There's something along those lines - MQS SD:

http://www.techmoan.com/blog/2016/12/13/mqs-sd-the-last-phys...