Also if there are multiple elevators, the one you actually called might stop unnecessarily.
Overall it's the same amount of stops regardless whether you take the right or the wrong one. But for some reason being in an elevator that stops without anyone getting in or out irks me.