I can absolutely write bugs. But I can be confident that there is a very well defined set of rules for what the compiler must emit given the characters that I wrote. That's not going to be the case for a LLM. You can perfectly express the problem you want it to solve and it just spits out garbage and this wouldn't be considered a bug in the system.