But that's not what happens.

I recommend reading "A Framework for Understanding Poverty" by Ruby Payne. It's a really insightful book on the cycle of poverty and the incentives at work... anti-social punishment really isn't part of it.