In general on the plane, you can fit a polynomial of n-1 degree exactly to n distinct points (i.e. it will pass through those points)
This least to an easy way to demonstrate the evils of over-fitting :)
This least to an easy way to demonstrate the evils of over-fitting :)