> For example, GPT-3 has been used to generate essays on complex topics such as the philosophy of mind, and these essays have been well-received by readers.

That's the other problem with GPT-3... it will happily say things that are absolutely false :)

I think this response actually illustrates my point quite nicely; it is a plausible sounding rebuttal but does not actually engage on a logical level.

That said, I don't mean to diminish the impressiveness here. It's quite evident that it could pass a Turing test in a wide variety of circumstances. After all, it's not like humans are consistently great at concept-informed writing either. I'm pretty sure the majority of undergrad college papers have more in common with GPT than with real critical thought... generating something that looks plausibly like an argument rather than actually having one.