I don't really get this kind of comments... Usually people also say the same thing when visiting Japan. "This restaurant only has menu in Japanese and staff only speaking Japanese!!".
That's true a bit everywhere in the world, isn't it? In the US, apart from places with say huge Spanish speaking presence, you better interact in English.
Try "getting around in life" using only say French, or Portuguese, or Japanese in a random US city like Portland, NYC, or Chicago.