The larger the group, the more corrupted power seekers will climb close to the top, and do the more damage (since they affect more people).
Maybe we can say that the human brain partly isn't well suited for living in large societies, for these reasons