Not necessarily. GPT-3 for example can put out entire articles, even generate images or generate valid HTML, doesn't mean it has reached AGI, and while it's far from perfect, it can still have utility.
As per the demo, I can imagine learning about a topic through conversations with an AI. It would still be regurgitating existing knowledge, but in a conversational back and forth way, which to some can have value.