The solution is downloaded playlists. It's annoying because you can't download an album, but have to make a playlist instead. It does work great though.