Spotify's DJ is alright, but it tends to loop through the same artists, at least for me. I'm looking for totally new artist discovery based on preferences / filters
It can either track your existing Spotify account as you listen to stuff and learn what you like, or you can just start using it and skip what you don't like and it learns pretty quickly.
It's not AI though, and hasn't changed much in the last few years, but works well, and a lot of people I know (myself included) consider it the best music recommendation system that we know of currently. Certainly leagues ahead of Spotify's recommendations!
(For users of the demo site, you can get a Spotify link to the generated playlist in the console. Shhh.)
The best recommendations are from humans who love music and you also share their taste in music.
Once every few years an amazing recommendation bubbles to the surface on Youtube for me but compared to a music lover's top 100 for a certain year? It isn't even close.
There is no reason you need algorithmic efficiency in this domain. 1000 recommendations might even be objectively less enjoyable than 10 recommendations since it will cause you to not explore any single recommendation all that much. Most of my favorite albums were not 1st listen instant favorites. Actually, quite the opposite.
A great album to me is also going to be out of sample and not in the training data of what I have liked in the past. That is a large part of its greatness.