Yes, I can definitely relate to this.
English is not my native tongue. I’m acutely aware of the presence of other non-native speakers in the room and instinctively switch to simple terms and avoid the use of colloquialisms. Native speakers generally do not have that instinct.