Mass, not really size. The smaller the object relative to earth, the more its course is changed by earths gravity.