Well, doing it over VNC is the Wrong Way™
Consider that texture sampling is optimized for a specific resolution, but how do you get that through a VNC window which can be scaled to any size by the host?
The right way is to render to a texture and grab the frame. See https://aws.amazon.com/blogs/aws/build-3d-streaming-applicat...