You can prove it easily by having many intense conversations with specific details. Then open it in a new browser and it won't have any idea what you are talking about.
Another weird one that applies so well to these LLMs: would you consider humans conscious or intelligent when they’re dreaming? Even when the dream consists of remember false memories?
I think we’re pushing close to the line where we don’t understand if these things are intelligent. Or we break our understanding of what intelligent means
people while dreaming are another case
is it ok to kill them