Interestingly, I often have the opposite problem here. The walk light turns on and I'm done crossing the street a good 45+ seconds before it actually lets traffic go. It would be nice if it somehow knew no one else was waiting to cross and let traffic go.
Of (not that I would ever do this) someone sees an opportunity and jay-walks but the walk light still turns on because they also pressed the button.