Your best bet is thrift/charity stores and ripping CDs. Super cheap and plentiful and albums are still put out on CDs.
Really ? My bandcamp collection is big and my BC wish list is huge... so much good stuff there.
I'm afraid there aren't a lot of places that are fair to artists outside bandcamp.
I have an extensive MP3 collection, favorite albums I try to keep FLAC, while others I'm fine with MP3/320 or for stuff I collect but don't listen to all the time, VBR 256 is fine to keep size small.
Generally, most bands make most of their money from touring, both from ticket sales and especially from merchandise (T-shirts etc.). They don't normally make much from CDs, and very little from streaming, that mostly goes to the label.
So if you really want to support an artist, go to their concert and buy a t-shirt. If a concert isn't convenient, you can probably buy a t-shirt from their website. This will do a lot more for their personal finances than worrying about copyrights.
Personally, though, I do like to buy CDs of artists I follow, and I normally rip my music in FLAC from those. A lot of the CDs these days are quite nice, with cool books sometimes.
I buy about 1-2 albums a week from bandcamp.
I know I can pirate but I really want to buy it legally in a way artists might benefit.
Places like Band camp have very small collections.
I know of 7 digital https://uk.7digital.com/
But for some reason "This store is not available for your location"