Not sure what platform you're using youtube music on but there are a few open source third-party apps for android that may have better offline functionality (though I have not either of them, I just came across them while searching different streaming music options)
InnerTune: https://github.com/z-huang/InnerTune