Couldn't the server compose the streams itself? Perhaps as simple as tiling them all together and the client can manage that stream, or request single high quality streams if needed.

There'd be a CPU/bandwidth tradeoff being made here, I wonder how the prices on standard cloud providers would compare.