This. There is no better alternative music service, but just yesterday I reinstalled Antennapod for podcasts. Spotify did a great job getting me hooked on some podcast shows, but the UI changed (need more taps and travel from the lowest to the highest button on my phone screen every time I want to use it) and features broke (e.g. it needs internet to list downloaded podcasts such that I can press play on one of them). After half a year of waiting for them to patch this worst of bugs I've given up and moved away. But yeah not everyone is going to remember using a different and open source podcast app years ago and can easily move back, most people will just stick with it. GDPR's automatic data transfer clause could really be put to better use.

For music I can't simply install an open source alternative. That I make a backup of the apk before hitting update says enough I think.