As a native speaker it appears to me that your audience is being a little uncharitable (they being, ironically, intellectually ungenerous toward you).

I wouldn't concern yourself with it too much. Both of your statements were entirely reasonable and polite in tone and candor. Hair trigger, induced outrage is common among Englisch. They are much less prone to such gewinsel in public, the knives only come out online for whatever reason.

Anyway, it is important to recall that with every move that is made, it will disturb someone else. Impudence should be avoided, but the trivialities and whims of Englisch are of little concern.