As StilesCrisis said, adversarial attacks do work on us. (naniwaduni makes a very good point, as well.)
Highly relevant: "BLIT" <https://en.wikipedia.org/wiki/BLIT_(short_story)>
Also, <https://www.quantamagazine.org/a-math-theory-for-why-people-...>
SCP calls such things cognitohazards <https://en.wiktionary.org/wiki/cognitohazard>.