It seems to hypothesise that a computer could never be 'conscious' just because it is made of switches, but we are conscious and just made of bundles of neurons.
The whole argument just seems to be "computers can't be conscious because they are computers", which is a fairly shallow take.
> Even the syntax that generates coding has no actual existence within a computer. To think it does is rather like mistaking the ink, paper and glue in a bound volume for the contents of its text. Meaning exists in the minds of those who write or use the computer’s programs, but never within the computer itself.
Do humans know their own 'true' purpose? Do humans know their own DNA sequences? If a 4-dimensional alien being came to earth, would they somehow be able to infer we have consciousness and a AI language model does not? (if so - how would they be expected to do this?)
(IMO the answer to all is no)