Same with programmers. The craftsmen feel the hit, the people that just saw it as a job and/or code as an obstacle to making a product say "what's the big deal, code was just a tool all along".
The end state is that more and more activity will consolidate to fewer controllers because of capital costs. Eventually the "makers" will be outcompeted by the few companies holding all the robots / AI swarms (at which point the other crabs in the bucket will say "told you so"). Sure you could create a startup, at which point your idea is instantly replicated (assuming it wasn't already thought of by millions of agents). Then you're merely facing the huge marketing, name recognition, and production ability of the megacorp versus your one unknown idea for the "factory" you "manage".
That's what's missing from the "factory manager" discussion -- how well can you compete with a Toyota factory? You're free to create your own factory right now. And just wait for the regulatory capture...