Why would the wealthy want you back in the fields?
You were useful in the fields to the degree that was necessary for food production (sustain and grow population) and for wars (using said population to expand and extract more resources).
Once machines automate material comforts and exertion of violence (already have, to a large degree), humans become a pure loss center. Why bother with "fields" lol.