Here's another test I'd like to run in a few years: Record both conversations, without revealing which is human, and ask strangers which they would prefer to continue talking to.
Honestly, I dream up some pretty wildly incorrect stuff when taking a stab at solving unknown problems. There's something about the way LLMs are vaguely starting to do 'something that feels like this' that strikes a chord with me. Imagination and creativity in the face of the unknown is something I value.
Maybe I don't have to care if you're made of meat, or possess a 'real' mind? Not a question I ever expected to seriously ask myself.