But it's likely those on a motivated search for evidence of LLM limitations ('cope') are going to tout & over-rely on this result – and miss the extensive evidence in larger models, with slightly-more selective generations, that self-training often elicits improved performance on domains of interest.
For example, both the 'UnnInstruct' and 'Self Instruct' papers (of December 2022) showed that if – rather than self-training on arbitrary generations – you ask a model to generate good examples of a certain kind of prompt and helpfulness, then train on those generations, the resulting model tends to get better on many similar challenges.
It's almost like, as with human practice/exercises, there's a spillover effect on related competencies - eliciting from the model a potential that was too fuzzy to exploit at first, but gets honed by effortful practice (even without additional authoritative-instructor corrections).
To me, it's eerily similar to human self-help routines - "give yourself a pep talk, visualize desired results, pick tiny positive steps doable once & keep doing repeatedly, imagine success, affirm all progress".
Or, say, the "Inner Game of Tennis" style of gently reinforcing some key skill into subconscious comfort, with broader effects: