Wikipedia has better culture. Shadow libraries and private trackers have more culture than you may need in a lifetime.
Would love to see a model trained on wikipedias only
I don't understand how culture is being used here. What does "more culture" mean? A culture is a process and a system of relations I can understand how wikipedia has a culture but not how a shadow library has "more culture than you need". Are we talking about the products of cultural production? To suggest that LLMs are anywhere near human level is laughable.