Driving shows it can be done, but even there it's taken years of highly directed research and investment, and driving (at least where Waymo operates) is still pretty well defined compared to plumber.
Such data can be gathered but the current methods of RLHF by paying white collar experts, accessing private datasets, etc. don't seem to really get at this.
I'm also continually surprised that people seem to think politics doesn't exist anymore. I find it exceedingly unlikely that massive amounts of people will simply accept this purported widespread unemployment without major political consequences.