That's probably good, because I'm finding it difficult to think of any consensual sexual practices that could feasibly be defined as "morally wrong" without the accuser being fairly described as a "bigot". I'd be interested to hear examples though.
For example, a coworker of mine is extremely against illegal immigration. Most people that don't know them assume that this belief stems from a hatred toward immigrants from certain 'undesirable' countries. But once you get to know them it turns out that it actually stems from a belief that the law should always be followed to a t -- they don't actually care one way or another about the issue itself, if the law said we had open borders then it would be no problem.
But we sort of run into a problem when people proxy their beliefs -- for my coworker it's the law, and for the religious it's their doctrine. Are people who subscribe to a belief system responsible for any or all of the intolerance that underpins it? Do people have a moral responsibility to audit their beliefs systems and look for intolerance? Do people have a moral responsibility to not follow an unjust law? Where you fall on these questions probably determines the answer to your question.