Right. Beat Saber works because the virtual world does not rotate relative to the real world. That rotation is what induces nausea. The player is confined to a small box in the virtual world; they never move very far, and the virtual world is locked to the real world.[1]
Games with that constraint are limited. You could do ping-pong. Shooting galleries.