It's not the size of the group, it's whether they hold arbitrary power over others.