In my fantastical imagination of that implementation, I would simulate "sim agents" as they live a life, collecting unique experiences that are the result of interactions with other sims. They then build up personalities, which influence their expressions in other mediums that real humans would consume. It's psychotic and possibly evil and I thought of it first, so no one better take my idea.
You might be able to see what I mean just in this comment itself. Could this have been written by an AI?
[1]: Or maybe CRAAP https://en.wikipedia.org/wiki/CRAAP_test
[2]: They quickly realized the trick is make high quality low quality content. 100 pages of gibberish is way less effective than a convincing essay that happens to include a few key falsehoods.
There is already a concern in corpora creation in ML/AI projects. Researchers would like very much to have human-only generated content when training models on internet-sourced text. People posting GPT-created output has the potential to taint these corpora and create all sorts of strange loopy feedback.
Has there been any successors to web of trust ?
OTOH, is proof of personhood really what we want long term, or is that just a proxy? Hypothetically, if an AI is good & trustworthy enough, why not allow a higher "source rating" for that than low quality human content?