If this is how the world regularly looks to you, then I have bad news. Likely, you are the jerk. This ....is not how the world actually is.
Could be. Or you could be surrounded by boring people with bad taste. Can we say honestly say those don't exist? Or don't exist in large groups?
Except when it's truly necessary to provoke some change there isn't generally an excuse for unkindness though. But that doesn't mean the company of boring people and fools is worth seeking out and we shouldn't have to pretend that they don't have those attributes.
As with so many other things jerk is a matter of perspective. If the fact I do judge inwardly if the company of a group or individual is worth my time makes me a jerk then whatever. I do try to be kind and polite to the best of my ability though.