Just want to note that GPT-3 does not understand anything, It has no logic, it is a language model.
Also, the rise of deep learning is based upon the rise of big labeled data.
Also, the rise of deep learning is based upon the rise of big labeled data.
I agree GPT-3 is * just * a language model, but then again, so are you.
Stepping back it is just a translation problem e.g. English idea -> Python code, which an ideal language model would be able to do.
I think what I’m picking a gripe over is that “language model” is a very general term. Calling GPT3 just a language model is like calling a human just a bunch of atoms. It’s not actually limiting.
What I’d love to talk about is how useful of a language model is GPT3? And how useful do you think GPT4, 5, etc. are going to be?