All of that is only marginally helpful without X sandboxing.
(There's not a well-supported way to avoid this, but there are some tools that use Xpra for it.)
We are in full agreement. On X11, the security model is: every application can see/do everything. You should only run an application in X11 when you fully trust it.