Have spent a lot of my life doing manual labor, and still slightly in that boat now but do have a proper office job (receptionist). it was incredible for me to experience my first office job and realize this general fact. Not only was my body not sore everyday, but my day was suddenly largely my own, my "labor" was suddenly not defined necessarily by constant action. I dont even really have to think as much as I did working in a kitchen, say.
Its just important to realize that this relationship with labor is a privilege, because trust me, its not "everyone". If that privilege is obtained because you provide something more "skilled", ok, I guess I understand that. There is still an instinctual level where it still feels unjust to me. But thats just my emotions, I understand economics trumps them.