This problem also exists when cycling on shared bike gutters where oblivious drivers veer out of their lane into the bike lane, roll through stop signs, or are just generally unaware that they're sharing the road with people not surrounded by 1 ton of steel.
A pedestrian stepping into the street isn't going to kill other people with their negligence - the burden of caution should not be placed onto them.