Yes. Associating with people based solely on their IQ is pretty misguided.
Just as joining a sports team doesn't mean you only hang out with members of that team because they enjoy the same sport - the same holds true for people who join mensa or any other group I'd imagine.