> but that would normally only give you ~60 - 100 ms lag

60 ms is already borderline even for conscious discernment of transactional state changes.

For self locomotion feedback that is a huge value. And for proprioceptive signals like mouse input it is absolutely astronomical.