Human ears have much better dynamic range than whatever crappy microphones are built into phones. Thus, when people are sitting next to each other in a public space, they can typically whisper, or talk just above the noise floor. This is as opposed to phones, which posses an uncanny ability to cause people to yell at the top of their lungs.