Snob, elitist, etc... I see a lot of names being thrown around to describe/explain/put down this idea of sports-disdain. Not saying you are, just pointing out that these words are coming up a lot.
At the end of the day, people will like what they want. They will dislike what they want, too. Whether that is because of a valid reason, or whatever silly notion of not wanting to fit in, or anything else is irrelevant.