Fertilized eggs have the potential to become fetuses, and fetuses have the potential to become babies, but fertilized eggs are not fetuses, and fetuses are not babies.
I think the spirit of your argument is that we cannot decide when to call a fetus a human. Like I mentioned in another comment, this grey area does not preclude undisputed humans from their constitutional rights.