It’s an arbitrary number that felt high enough. If I said 10, people would argue that a frontier model can talk longer than that. But I have absolutely watched ChatGPT fall apart that quickly. I’m sure everyone reading this has.
We can nitpick the duration all you want, but we both know it does not take very long for this to occur. It happens particularly fast if you stray from the original topic and/or aren’t using a frontier model.
I am not going to call something “intelligent” when it can’t sustain a basic conversation.
Also, I would say SOTA LLM models can sustain a longer, more intelligent conversation than most people. Just in context length alone, they can keep track of more context than humans. But they're nowhere near as efficient the human brain, or the attention to quickly connect and find decades worth of memory like us.