Not all training data is human generated, and it's also not clear that being ridiculously good at interpolating between data points (whatever that means) will not lead to superhuman capabilities.
We have these breathless conversations about the new AI frontier at the peril of losing sight of reality and our own human potential.