"It's like Microsoft 3389 RDP without fullscreen but each individual window"

Sounds more like plain old X forwarding.