I love the VR experience of Gran Turismo for driving. It is truly immersive in ways that is hard to communicate and makes me glad I have the VR. Even with that, the game is not nearly as fun without a force feedback steering wheel. Not even close. To the point that a moderate screen with the steering wheel is a better experience than the VR without.
To the point that the idea that I will do any elaborate hand/arm gestures to interact with something I can't feel, just doesn't seem like something that will fly.
Do I like that it has the ability to work without a controller? I mean, sure? But I also have no problem using controllers for gaming, and I don't see that going away anytime soon for a lot of games.