Note the existence of the included Pipeline audio/video server. The article mentions it should be low enough latency that it could be used in professional audio while also be approachable from the "normal user's" perspective.
I may try Fedora just for that.