I know of a couple of people I really trust that tried to explain to me how they feel when they try math or programming and it's more like a physical pain almost than frustration. I always also got frustrated and always thought everyone just has to push through it but I wonder if there's something deeper. Those two people really led me to believe some of us have some harder "blockage" than others to get through, and it's not related purely to being generally smart.