One thought comes to mind. What if the button light is not working? Hit the N button once, and you are on your way to floor N. But if the light is busted, you would hit the light again, and now you have deselected your destination. I think button presses should be indempotent for this reason alone.
This is why the standard practice of picking up the elevator phone and requesting a floor cancellation exists.
Seriously? Has anybody reading this ever done this? It seems to me that by the time the operator picks up and you tell them what you're trying to do and what elevator you are on it would be too late.
Or in a crowded elevator a 'malicious' user blocking the view to the buttons deselects all but their own floor.