Obviously LLMs are, and will always be harder to "prove" correct than a compiler. However it's the correctness of the resulting software that matters, right? Coincidentally, LLMs can also help a lot with automated testing and static verification, so maybe the resulting SW won't be more bug-ridden than before LLMs were a thing.

The preference in most industries has always been towards producing more code with some bugs rather than less code that's nearly flawless. Given that, I'm pretty confident that soon I'll not even read code anymore and become a tester (and/or req engineer) instead.