... well that's one thing that's new.
The other thing that's new (and more structurally relevant, since obviously not all LLMs do what you describe) is the dramatic reduction in cost affiliated with this strategy.
It's (literally) unbelievable that this many allegedly sophisticated people on HN have no concept of cost and what dramatic cost reductions can achieve.