I only tried Claude because ChatGPT UI is really buggy for me (Firefox, Linux). It frequency blocks all interactions (entering new text or even scrolling) and I have to refresh the page to resume asking questions. But on Claude, it was just crashing altogether when I went to open to sidebar. Seems like traditional engineering is still a problem for these AI companies.
It is buggy on every platfrom in my experience.
This is maybe 1/3 of my use of GPT4. Quite often, the log dump and nearby code is enough, often even without explicit instructions. Being able to do this task is similar to GitHub CoPilot code autocomplete working well too. Still not 100%, but right often enough that it flipped my use from not-at-all in GPT 3.5 to quite-often in GPT4.
It's a bit of a misunderstanding of how LLMs are supposed to be used.
One caveat is if you're very untalented, it might be able to solve very common patterns successfully.