I'm not deaf (actually, one of my ears doesn't work, but hey...) but I understand completely what this guy says about feeling like he's missing out on everything - I moved to a France to work, and my French is... poor.
Everyone speaks English, but only to me. Figuring out what's going on at a high level is really difficult (me: "Where is everyone going?" them: "To the new office." me: "WTF? We have a new office?!") but worse is missing out on all the in-jokes and messin' around. I'm not saying it's the same thing as being deaf, but it turns out that stuff is pretty important.