For me it buffers a lot when switching so it doesn't keep the rhythm and the syncing is wasted.

And I have a pretty good internet connection. I never get buffering on youtube.

Anyway, great idea.