I hate VR controllers. I'd prefer to play VR games without them. I'd prefer they do hand and eye tracking to determine what I'm doing, like look at a zombie and and go pew pew pew with my finger guns.
The only VR headset I've tried that can do hand tracking (Oculus Quest) sucks at it and games there didn't pick up on it as an input at all, as far as I know.
However, just because VR controllers won't exist for the Apple Vision at release it doesn't mean they never will. Perhaps Apple will release some later, or it'll be a third party release. Heck, someone might unironically release a Nintendo Power Glove style controller that works incredibly well with Apple Vision.