The same argument can be brought when comparing top 40 pop music and jazz, say. There isn't an objective truth to aesthetics, but that doesn't mean that everyone's opinions has equal depth or nuance.

Some things you get more out of if you choose to spend time with them, but will in turn change your own sense of it, and the experience you are having.

So in some sense you actually do become "better " at tasting/listening well - or at least you become more sophisticated. Which doesn't invalidate the enjoyment that someone else can get from a more superficial engagement, at all.