One can take many good ideas from less wrong, yudkowsky et al without adopting a rationalist identity. Sure, it attracted wackos and they made a cult or two. But that could happen to anyone!
Aha: "identity". You nailed the misgivings I couldn't articulate. Thank you.