ChatGPT's language model doesn't remember chatting with you. It doesn't remember anything not in the training set. It's stateless.
It only seems to remember you because the chat transcript gets fed back in again. No "game" is running, most of the time. There's no other "game state."
There is a writer. It can continue stories with convincing fictional characters. But the fictional characters consist entirely of words. This is the same sort of existence as the fictional characters in a novel.
The helpful AI assistant itself is a fictional character created by the writer. Each time you start a chat session, you create another clone.
If you wanted to keep a story going, there are other writers. The writer you're using could be replaced. It should make upgrades easy as technology improves.
Looks like we are going to end up chatting with increasingly intelligent fictional characters who don't actually exist. What sort of meme-creatures consist entirely of words?