That's a fine book. But to answer that question surely calls for emperical data?

Generations of teachers of mathematics-- surely not all incompetent-- have found that many people, perhaps most people, do not love math. There are very good teachers (I had a few), and very good ways to teach it (shout out to the Mr Barton Maths podcast), but experience shows that it is a hard go much of the time.