I have found that whatever peace blocking noise gives you, it is more than offset by the paranoia of being watched or the terror of people sneaking up behind you.
For me visual distractions (even if it is just people walking) are a lot worse than noise. I can tune out the chatter but whenever I feel or see movement around me, my head snaps to attention to find out what it is. Some evolutionary thing most likely