This is sleight of hand. The training data almost certainly includes thousands of grade schoolers and linguists. Your argument seems to be that this is all generated ad nihilum from first principles (it's "just" a computer program bro), but that's not how it actually came to be. Rather, it was trained on literally terrabytes and terrabytes of human-generated data.
So, in a sense, it is actually a linguist. Just a really bad one.