A farmer and a landlord are different things. My family are farmers, I've been a landlord. (FWIW, before anyone calls me a hypocrite, I paid back every renter every penny of profit I made from them plus appreciation.)

The labor that the farmer puts in should absolutely be rewarded. But the labor of a farmer is absolutely nothing like a landlord who makes money purely because they had enough money to buy housing. Plenty of landlords hire property management firms, and do little to no labor at all, but still make a profit.

That modality doesn't exist in farming and food the same way it does in housing today.