If you had a language model whose responses were indistinguishable from a human, would you call that understanding?
I agree GPT-3 is * just * a language model, but then again, so are you.
I agree GPT-3 is * just * a language model, but then again, so are you.
Stepping back it is just a translation problem e.g. English idea -> Python code, which an ideal language model would be able to do.
I think what I’m picking a gripe over is that “language model” is a very general term. Calling GPT3 just a language model is like calling a human just a bunch of atoms. It’s not actually limiting.
What I’d love to talk about is how useful of a language model is GPT3? And how useful do you think GPT4, 5, etc. are going to be?