I always hit all crosswalk buttons, even if I'm not crossing, because it's nonsense that pedestrians have to ask permission to cross the street while the lights always change for drivers.
The world will be fair when drivers have to get out of their cars and push a button to get a green light, while pedestrians automatically get a walk signal every cycle.
After 50 years of that it'll be even, and we can go to a system where everyone gets their turn automatically.