It seems much more likely that outsiders looking in on an obscure field resent the work it would take to understand the field, so they bash it. Unlike other complex fields, including any of the sciences (except astrobiology, which clearly is bogus. And maybe evolutionary psychology, which is borderline), lit crit doesn't do much work in the world and most people wouldn't miss it if it were gone. So, that compounds our resentment of having to work to understand it. In other words, it's tough to understand, there's not an obvious payoff for understanding it, so it's easier just to write it off.