I find it hard to imagine to use the current bw only and grainy cameras of e.g. the quest 2 for such tasks, it really doesnt feel natural. But might be easy to improve this in future generation hardware
If you are using it the other way around as a kind of real world view with only a few AR elements on top it gets old pretty quicklY