The very nature of having a large group of people thinking the same way, executing their lives in a way pre-determined is a very bad thing. You can label it however you wish. An atheist is basically someone who has identified what they are not. When you talk about "pretty non-religious", you're talking about unlabelled or not completely adherent atheism. That's still a great thing. Nothing wrong with believing in some thing as long as someone else didn't tell you to.
The argument "It's good that a large group of people believe in a single ideology and adhere their life to it" will never have wings among intellectuals. Now, if you take that argument and apply it, you won't go far down the road when you'll invariably have to talk about religion. Do you excuse it? Or accept that it is one of those groups?
Excusing it is callous and hypocritical.