In my own farting around with AutoGPT (which was quite a lot), what stuck out to me most was that the agents wouldn't rely on their own "knowledge" for tasks hardly ever. They would always default to browsing the internet for trivial questions and so it would take a good 10 minutes to arrive at a conclusion ChatGPT would've gotten in one-shot.