I doubt even the premise. Hydrogenaudio users (ie. audiophiles) can barely notice any flaws with 96 kbps lossy[1]. On a rating where 5 means "imperceptible" and 4 means "perceptible but not annoying", 96 kbps AAC scored 4.4, and 96 kbps ogg (vorbis) scored 4.2. Spotify premium uses 320 kbps ogg, which should firmly put it in "imperceptible" territory.

[1] https://listening-test.coresv.net/results.htm

I doubt the premise too, but assuming you believed it, how low would music appreciation have to be in your priorities to be willing to develop that skill?