There's some work being done on optimising Proxies, but the current implementation is just slow (and also varies by engine), but yes, they can probably be optimised further.

EDIT: there are various blog posts around talking about optimisation: https://v8.dev/blog/optimizing-proxies