So it turns out, non-tactile controls can be exhausting to use. There's nowhere to rest one's hand, so simply holding state requires constant expenditure of effort.
This is why joysticks are such a saddle-point in the UI space: motion controllers are great for novelty, but the industry keeps gravitating to joysticks and buttons.