There is a ton of stuff not on Spotify. It might align well with your tastes, but they are subject to licensing issues. I’m not even talking about live versions or sessions, but bog-standard albums.
And another thing - I've discovered lots of artists through Spotify and Youtube. If they weren't there - I would't even know that they existed.