Reversing that argument, you'd probably feel that French tourists wearing monokinis (or kids not having a full on bathsuit) on the beach in the US don't respect your culture, even though that's perfectly acceptable back home.
Usually the weird rules we have for ourselves are never visible to us so I’d be somewhat hesitant to make the claim of being open to things.
In fact, if I think about it, you’d probably be stared at and feel like a spectacle and probably unwelcome with a toga, a kilt, or a lungi (even the formal variant). I don’t even think you could wear the top end of some of those clothing varieties and go to many places in SF (generally a downmarket place for clothes).
The other guy put it really well. It will increase the friction you experience.
Actually, I'm purely merit based in my judgments. You can wear a leaf on a string and water wings for all I care. Then again, I also don't much care what prejudiced people think of me. I just go about my business feeling sorry for them.