One of the biggest hurdles to automation in general - especially where replacing skilled workers is concerned - is in teaching (algorithmically or otherwise) the machine to replicate what the skilled worker is doing.
If there really is the existential crisis of "machines taking our jobs" then why are the robot trainers not pushing back? Isn't is immediately clear what they are doing?
I personally think everything should be automated with no mandatory human inputs for the majority of tasks - but that is hundreds of years away if ever. The key sticking point though is whether people will be willing to be "the last human to hold this job."