Your statement is very general in nature. I assume you mean humans, and I assume by feeding you mean a sustainable process. Would you please quote your sources here? The modern industrial agriculture that keeps modern society alive is based on efficiency innovations such as the Haber Bosch process, soil management, antibiotics, automation, transportation etc that being huge scale effects. Personally, I have no idea of the human population ceiling if all were optimally distributed home farmers. It sure would come with inefficiencies.
source: had some interesting conversions with individuals from the from BASF/Cargill/Tyson Foods.
> To be perfectly honest I'm not an expert (...)
It is a super complex topic - biology, farming, engineering, markets. Hard to be an expert here. Let us hope one shows up and writes a comment :^)