Your setup sounds a lot like gitpod.io
Also have arch + i3 + openrdp dev containers which work awesome. Even with multi-monitor support. The only thing missing is gpu acceleration. Then it would be perfect.
Any chance you've published the build files somewhere? This sounds fantastic