Which is why the Quest 2 and Horizons Workrooms can track supported keyboards[0] and the next gen headsets will have full color passthrough. These problems are being recognized and solved as we speak.
[0] https://support.oculus.com/articles/horizon/getting-started-...