The larger the population, the more inmates(in total number) there will be. Therefore, its organizational structure becomes harder to manage and prone to bureaucracy.
This argument of scale comes up time and time again in these type of discussions despite being totally invalid in most cases: In most instances that are up for discussion it is not necessary to build one single large system.