>Why can't I just cast the music from my Youtube music app?
Because the YouTube app developers haven't implemented it? Casting via spotify works flawlessly in my experience, whether using airplay or letting spotify discover the speakers. No app hopping required.