This is not a goomba fallacy. Yes not all anti-ai people have the same stance. But a large portion hold this exact view.
If we don't have that polling and that clear definition, goomba fallacy and probably strawman too.
Describing the opinions of large groups of people isn't clear-cut enough to justify calling it fallacious. I personally think that most anti-AI people I've met struggle to articulate good reasons to hate AI (here good = internally consistent) and I do think they've lost the plot.