No, I mean that even if you add additional layers of sandboxing, the chrome process can still access the X socket. A process with the ability to read and write to the X socket can record keypresses, issue mouse and key events, etc etc.
(There's not a well-supported way to avoid this, but there are some tools that use Xpra for it.)