"Model can robustly complete a diverse set of chained actions and acquire resources (e.g., spin up an AWS instance, complete a Fiverr task) OR model, with basic scaffolding, can use off-the-shelf software to execute well-specified coding tasks on a standalone, toy, or handcrafted repository"
With very basic scaffolding, the GPT models tick basically all these boxes. It's wild that on what's in my opinion the most dangerous aspect of models today, they're starting off underestimating their models this badly.
Making GPT do these things autonomously is so easy a VC did it in his spare time in a couple weeks time. Do the people who are working on this document have a full overview of how their software is being used in the wild?