I like the note that there is a new risk since their model can access the web at training time. A model in this situation could potentially do something malicious online!
[later]
"Oh no."
---
Ha-ha-only-serious joking aside, this is impressive. Early on in the API release, someone showed you could sort of make GPT-3 operate on text representations to put inside a web loop, but it made a lot of errors. This goes well beyond 'sort of'. It may not seem like 'predict the next word' gets you far, but turns out, it's a good starting point. ("Tool AIs want to be agent AIs.")