I wish people would stop spreading this as if it were the main reason. It’s a weak argument and disconnected from reality, like those people who think the only ones who dislike cryptocurrencies are the ones who didn’t become rich from it.
There are plenty of reasons to be against the current crop of AI that have nothing to do with employment. The threat to the environment, the consolidation of resources by the ones at the top, the spread of misinformation and lies, the acceleration of mass surveillance, the decay of critical thinking, the decrease in quality of life (e.g. people who live next to noisy data centres)… Not everything is about jobs and money, the world is bigger than that.