Agreed. I think it's very likely that a ban would be upheld against a Free Exercise challenge (even though at least one lower court did strike such a proposal down on this ground).
Some people think it would not survive a Due Process challenge, though, because there isn't a strong enough basis to overcome a parent's fundamental right to make decisions about their child. I could see that being a close question.