This is basically because (one of?) the only times our eyes don’t do saccades is when they’re tracking motion. In other words, you can’t move your eyes smoothly unless you’re following something (like prey or a finger). In this case, you’re tracking the boundary of your periphery!