If we are talking about many smaller sites more evenly distributed to where people are living (and likely, not people not aggregating into large metropolitan areas), I think it can work.
A lot of stuff would have to change. Permaculture isn't just about farming. Other things like human waste would have to be made as part of the nutrient-cycle. We have a lot of compostable food wastes going into landfills generating methane. We have landscaping practices that eat up water, or get rid of what could be fed back into the ground. We have a ton of food that never makes it to the supermarket because they are not in standard sizes fit for the retail market. You have planting practices that makes it easier for machines to harvest, or to grow to standard types, but it generates a much greater need for synthetic fertalizers.
You can't just run the numbers the nitrogen input of the farms. You also have to look at where all that stuff is going, and a lot of where it is going never makes it back as input.
[1] https://geneticliteracyproject.org/2018/02/16/usda-data-conf...
(I'm not suggesting it's directly a problem, the issue is that it's real hard to figure out the nitrogen budget society ends up with if all synthetic fertilizers go away)
During the economic sanctions, Cuba was forced to stop using synethetic fertilizers, pesticides, and even tractors. They could not import enough to be able use those at scale. The people there had to adapt and work out how to live.