I don't see why smaller societies should not be able to thrive. My grandparents said once that back in the day you could identify what rural village someone was from by their accent. Meaning populations inside of villages changed very little. And most of these villages did just fine with populations as low as 200.