I think that's the great thing about voluntary association and freedom in that sense in general: you can associate with those who are like-minded and willing to work with you, and you don't have to/aren't forced to associate with those that disagree with you entirely - and those groups can't really get at you as easily. In open source, it's just a more pure version of that because you essentially have infinite "space" to spread out, and you can just clone stuff.