I have to say as somebody who through attrition always feared math in university that it is meaningful to think about reasons why people fear embracing certain types of knowledge. It's only after the fact that I realize how useful and even how romantic applications of mathematics might be.
I might never be a starry-eyed or an often-drunk academic, but I've grown to really see my initial lack of mathematical learning to be an immensely high opportunity cost. So I can relate to anybody who thinks of structural reasons people might shy away from math and indeed all forms of intimidating knowledge.