It seems to me it is more because your eyes can't move if they are locked all the way to one side.
" Smooth pursuit eye movements allow the eyes to closely follow a moving object. It is one of two ways that visual animals can voluntarily shift gaze, the other being saccadic eye movements. "