Imagine a software developer who refuses to use IDEs, or any kind of editor beyond sed, or version control, or some other essential tool. AI is soon similar, except in rare niche cases.
The rest: if they are just as productive as others, I would not care one bit. Tool use as a metric is just bad.
One professor thought syntax highlighting was a distraction.
Lots of colleagues used vim/helix instead of IDEs.
I haven't met anyone who refused version control from an intelligent standpoint.
The most reasonable objection to AI from people who don't hate it are:
I just don't know how it could help me; it's not as skilled as me at my job, and I'm already doing fine.