If you watch your eyes in the mirror and move your head, your eyes appear to do an incredible job of tracking using eye muscles. Are they actually? Or are they actually tracking jerkily and it appears smoothed due to saccadic masking?
When you're focusing/tracking something your eyes do a different type of movement called smooth pursuit [0].
To see this in action, look around normally - notice your eyes move and then stop, taking in "still frames".
Next, look at your finger and move your finger around. Notice that your eyes smoothly follow the finger around.
If you are not following a pre-existing "line", it gets exponentially harder.