To produce the same amount of food will require more total resources, including land area, energy, and environmental damage. Your small-scale organic farm-produced product is a luxury good, with luxury inputs.
Truly organic local food has been produced sustainably for millennia, so to call that a luxury while wallowing in cheap oil subsidized corn food is totally backwards.