You’re forgetting about foveated rendering. You don’t need the 4k60 stream if you’re not looking at it, and you can only look at one screen at once. I think it’s doable.
I suspect next generation of this solution will stream each window individually, and let you place Mac windows freely around your environment. Then you don’t need to stream anything from static windows, you mainly just need to stream data from the window you’re interacting with at the moment.