The more real (and observable today imho) problem is: in general, people aren't really good at, interested in, or have time for thinking deeply and critically, and some things matter, a lot. So if they can't (or won't) think about these things themselves, and you remove a religious rule, it creates a vacuum where anyone or any "-ism" can enter and replace religion's influence on public behavior.