At least with iOS 16 this isn't an issue, not sure about prior versions. In Settings for Apple Music, it shows you a list of all artists, inside their listing is the albums, and inside there the songs you have downloaded. You can delete at each level (artist, album, or individual song). But it definitely removes items from the cache or, yeah, I'd have been out of storage a long time ago.