Oh, I was mostly describing network latency and file IO cough should apply to mouse polling as well but bear in mind what another user has said. For mouse specific concerns, I would take a look at the following tutorial:
https://www.quakeworld.nu/wiki/Smooth_Quake_in_Linux
Best of luck!