Just consider the context window
Tokens falling off of it will change the way it generates text, potentially changing its “personality”, even forgetting the name it’s been given.
People fear losing their own selves in this way, through brain damage.
The LLM will go its merry way churning through tokens, it won’t have a feeling of loss.