> I really don’t see how LLMs are different.
Output from compilers is already verified - after all they have an extensive suite of tests.
With LLMs you're getting into the role of someone who keeps validating the compiler over and over, because its output is not deterministic.