It seems like it tends to converge into infinite loops at some point.
Example by directly inputting a repeated "What?", originally obtained with a different piece of initial text, and observed with other starts as well :) :
Prompt:
"What?"
"What?"
"What?"
"What?"
"What?"
"What?"
"What?"
Response:
Same
I suppose it's kind of GPT's game of life :)