When it becomes an instrument of social control, whether that means using religion to excuse bigotry or merely using religion as an excuse for manipulation or control in your own household, then I can no longer agree and feel it is an intrinsic civic duty of all people to actively discontinue that portion of religious practice.
Somewhere there is also a gray area related to what I would call “faith-based reasoning.” In some circumstances it’s fine to make decisions by consulting some form of faith. But in others, say denying a child’s medical care, it is clearly indefensible.
On this side of things I subscribe to the idea that was described on LessWrong in terms of “making beliefs pay rent in the form of anticipated experiences.” Along the same lines I admire a quote from Robin Hanson: “I wish there was less of a feeling of entitlement to believe whatever you want, and more of a sense of social responsibility to believe accurately.”