I fear that LLMs are going to cause the internet to be a much worse and less open space.
I fear that LLMs are going to cause the internet to be a much worse and less open space.
Let data be free! If someone wants to use it to make money, well, it's open, just like open source. It's still not okay to take open source work and claim it as your own, which is what copyright should be limited to. Stealing a photo or plagiarizing an essay is intrinsically different than just having a copy read by something, be it human or an mechanical process such as training a LLM.
"corporate this" and "corporate that" are handy rhetorical flourishes but they distort the debate.
OK, so if a writer X has a blog to put up samples of their work to drive people to buy books and to get writing assignments and someone uses ChatGPT to write something in the style of X - this naively seems like a hit on that author's ability to sell their skills.
And I don't think it is fixable by making the AI act more like a search engine.
Basically AI is structured to make every result an answer onebox whereas in search this only happens sometimes.
If the AI is good, then the author's economic outlook is bad regardless of style.
Regardless of if the AI is or isn't good, then I can still see it being brand damaging, but my gut feeling (IANAL) is that this is more of a trademark issue than a copyright issue, as it's passing off as something it isn't.
It’s not clear to me that having their content “unindexed” is good for authors. It’s probably good and bad at the same time.
One could easily argue that it's unlikely it'll get worse - if anything, AI could empower competition as now a group of 3 passionate, free writers can compete with agenda-driven, for profit corporations on a similar level. This could very well make the web more open and free as it makes the web more accessible.
Now? Yes. I grew up when it was just ugly, and by ugly I mean animated gif backgrounds with obvious seams on the tile boundary.
*old man shakes fist at The Cloud*
And that's probably just 1 year. There's data that's vanished over time. The point of all this is that they're point-in-time references of the internet.
the more practical thing is that (the royal) they have set up a rclone like utility that allows you to retrieve a slice of the whole snapshot, if you know your domain.
it would be extremely funni if commoncrawl was a de-facto ipfs, allowing queries along domains (or arbitrary dimensions/clustering) of interest.