One thing that I think GPT-3 does show is that NLP technology has now reached a level of sophistication where it becomes possible to use it in a wide range of new and different applications.
Exactly. The real innovation here is NLP, not GPT. It will take time for the technology to become democratized, but it no doubt will. GPT will become one expensive API compared to the dozens of smaller, cheaper, and more focused APIs.