[dead]
Thanks, this only cements where Devin lies in comparison and explains the lack of benchmarks and independent testing…
While Devin handles routine development tasks well, it still requires oversight and guidance when dealing with complex integrations or custom business logic. It was helpful in reducing the time spent on boilerplate code and basic setup tasks.
Definitely LLM slop. Shameless.
So dang clumsy. I mean come on.