It's not about real time, is more about sound, lot's of people are not used to the sound of words, and if you are from a place whose native language pronounces the letters very differently, you won't adapt easy. It's not timing, as people's brain might even change to english as base when writing and it's immediate, not translating, but when you can't understand well the sounds, than conversations go south really fast.