As an agnostic, I wouldn't call them "sad," but it's like Neil deGrasse Tyson said. [0] It's fine to see people interested in golf congregating and talking about it, but it'd be stranger to see a bunch of anti-golfers congregating and talking about how they don't like to play golf.
[0] https://twitter.com/jonathan_blow/status/273582094448476161