What are one of the professional use cases where you would just feel comfortable YOLOing some ChatGPT generated code into prod? Publishing a journal without verification etc?

You should also take note of the warnings in the GPT-4 manual, it's a much more convincing liar than GPT-3. Quite explicitly says that.

My fear is that I just get lazy and trust it all the time.

I think one of the reasons AI art has absolutely exploded is because there's no consequences for a generation that fails and it can be verified instantly.

What are you talking about exactly?