It seems like they need to follow the exterior path of the current 'blob' as well as the destination shape as it's being formed. If they all moved at once, it'd be pandemonium!