Open track with neural net tracker can do what you're asking. The default configuration is a bit wonky but it works very well after some smoothing here and there.
There have recently been some cameras released that don’t require ir-clips and offload the computer some, but feels =\ having a webcam requiring constant camera and/or tracking.
But for games it’s great and already in use.
A system that uses a visual light camera and no reflector clip will inevitably be slower, as it is a much harder computer vision task. But I don't think hardware acceleration comes into it anywhere.