Uh, I think this should be a thing considering we have LLMs training other LLMs. so we end up with this BARF loop.

There is an actual interesting question here if BARF loops can create new synthetic knowledge, or if humans need to be the 'spark of novelty' in that loop to drive it to new knowledge.