I think their point is about rich people who don't need a job or money, but now treat hard labor jobs as gym work.
These sort of people can always go back to what they were doing after they got fit from the gym work, and of course they can always do another gym work sort of job at will.
This is far different than somebody working these jobs to put food on the table.