Disclaimer: I have not delved into AI to any great degree.

Where this kind of statement ("Holy crap! It wrote me a program and it worked!") tends to make me skeptical is this: the program always seems to be something that's already been done a million times before.

IOW, something that was probably somewhere in the model's input dataset.

I would want to see it produce something truly unique that I'm trying to do for my business -- something that's never been done before. Then we can talk about AI's ending coding.

Until then, they're going to be a tool used by actual coders IMO.