It is the lack of religion, because religion is exactly what would fill this gap in the minds of people from seeing injustice. Maybe the earthly judges failed, but I don't need to be cruel and punishing because the criminal will get what's coming for him in the next life.
It doesn't even matter if this argument is true or false, and if there is another life and judgement in it. That line of thinking clearly keeps people more civilized. Here in the present, in an objectively observable way that even complete atheists could compare.