Yes, I work in an open plan office so because they can see me they think it's OK to interrupt me whenever they feel like it. I'm in a room with the support guys and testers so all their phone calls I get to hear. Especially distracting if they're talking to a user about something I've worked on. Sometimes I manage to space out and not hear it but then you look up and people are staring at you "what do you think Bob?"
Headphones only go so far.