I thought a lot about it and realised discriminating is much easier than generating.
I can discriminate good vs bad UI for example, but I can't generate a good UI to save my life. I immediately know when a movie is good, but writing a decent short story is an arduous task.
I can determine the degree of realism in a painting, but I can't paint a simple bicycle to convince a single soul.
We can determine if an LLM generation is good or bad in a lot of cases. As a crude strategy then we can discard bad cases and keep generating till we achieve our task. LLMs are useful only because of this disparity between discrimination vs generation.
These two skills are separate. Generation skills are hard to acquire and very valuable. They will atrophy if you don't keep exercising those.