People do use VR for modeling/animation in Blender - https://freebirdxr.com (disclaimer: I'm the author of this plugin)

Freebird is still quite basic, but it's under active development and more modeling and posing features are being added.

So a core set of people definitely use VR in Blender for creation/editing, but I agree the number is quite small.