You probably shouldn't walk outside with our headset on, but indoors, absolutely. Turn on passthrough and off you go.
Setting aside that griefers would pull it off your head and destroy it, why not? If you're using it for directions, it seems safer to keep your eyes on the environment than it does to split your attention.
But the video explains it pretty well :)