The real problem here is latency, and I'm good friends with the folks who are working the hardest on that issue for real musicians wanting to collaborate with each other in real time. The most important work is being done with SoundJack.
https://www.ianhowellcountertenor.com/soundjack-comprehensiv...
> In practice, musicians ignore sound and watch a conductor when separated by such distances [of 100 feet].
It had never occurred to me that a conductor was a kind of clock at an approximately uniform distance from the performers.
If you are 100 meters away, you have delay of about a third of a second if you use sound, but for light it will be a fraction of a millisecond.
Doesn't matter for the performers, but it matters for the conductor.