I think it was specifically just minarets.

https://en.wikipedia.org/wiki/2009_Swiss_minaret_referendum

Now, you might find even that a bit overbearing, but I believe the right of a community to influence the architecture of their local town shouldn't be seen as a bad thing. The feeling was that the few minarets that already existed were incongruent enough, that they didn't want a carte-blanche on more sprouting up, which I think planning permission had already been applied for.