What I care about is that, as a paying customer who has no interest in podcasts at all, I have a podcast section front and center at the top of my home page with no way of removing it. I'm annoyed that many of these podcasts have pictures that are not safe for work when I try to use Spotify to listen to music at work. I'm annoyed about being automatically opted into pop-up advertisement despite paying for an ad-free experience. I am annoyed about more and more music that is nothing like any of my listening habits being mixed into more and more of my mixes, and later finding out that artists have the option to pay to have their music treated preferentially and inserted into unrelated streams. I'm annoyed that I have music playing regularly that I don't like and I don't want to listen to, but I can't simply tell Spotify to not play it in the future (the official response being "Just listen to more music that you do like, and the AI will learn eventually!")
Spotify was a platform with an ad-supported model and a paid ad-free option, and now it's a platform with an ad-supported model and a slightly-more-subtle ad-supported paid option. Not worth it. A modern music platform having no ability to filter out music you don't want to listen to is unacceptable.
The controversy has a lot to do with what's wrong with Spotify right now (podcast-pushing and chasing more and more ad revenue, treating even their paying customers as nothing more than an advertisement base to leverage for more revenue), but it is a symptom of the ad-revenue chasing greed that's infecting everything right now.