"Trained on gigabytes of input, GPT-2 is uncannily good at producing sensible text by simply predicting the next word that should follow a given list of input words."
There are now a few systems like that - autocomplete with a big text database. They have no underlying model of what they're talking about. So, after about three sentences, you realize the output makes no sense. It's just words strung together with probabilities that match known text.
This seems to be where machine learning gets stuck. There needs to be some underlying model of the subject matter to have a useful dialog. Outside of well defined subject areas (sports, weather, travel planning, shopping, etc.) that barely exists. Frustrating to see this half a century after Eliza.
Chatbots have the same problem. Either they force you onto a specific track, like a phone tree, or they just natter endlessly without going anywhere. I've been playing around with Rasa lately. This is a chatbot which uses Tensorflow to match user questions with canned answers. That's about all they get from the machine learning part. Outside of that it's a phone tree engine. There's a file of "smalltalk" questions and answers, so it can natter better.
What do we want? Chatbots!
When do we want them? Sorry, I don't understand the question." - bag at chatbot conference.