Watching GPT write code hurts my brain.

It starts at the first character, works forward one “token” at a time, and ends at the last character. Never moving back.

It feels like it knows where it’s going at the first character, even though it doesn’t.

It’s like it starts speaking a sentence and, by the time it’s done speaking, it’s written a syntactically correct Node.js application.

The way GPT communicates in English does seem similar to how humans communicate. The way GPT writes code doesn’t seem to come close to approximating how humans do - it’s an entirely different mechanism. Humans generally can’t write code without a cursor and backspace.