From Anthropic a couple days ago too, self finetuning:
"when assessed by Claude 3.5 Sonnet’s production-grade RM, our unsupervised assistant policy wins 60% of head-to-head comparisons against the policy trained with the human-supervised RM." So now the models can even post-train the new models better than a human can
Unsupervised Elicitation of Language Models - https://news.ycombinator.com/item?id=44276041