You're completely missing the point of OP's comment, and strangely, ironically lending credence to your interpretation of that comment lol (self-inflicted harm).

We don't have a good scientific or philosophical handle on what it actually means to "think" (let alone consciousness).

Humanity has so far been really bad at even using relative heuristics based on our own experiences to recognize, classify, and reason about entities that "think."

So it's really amusing when authors just arbitrarily side-step this whole issue and describe these systems as categorically not being real but imitating the real thing... all the while not realizing such characterizations apply to humanity as well.