Its weird how people keep saying the rise of AI generated content will "kill AI" as though the companies training models don't have complete archives of all the data they already scraped from the Internet.

It doesn't take all the text of the public Internet for someone to learn to talk, and all these companies are much more in the data curation business for the purposes of teaching models.

Scraping is to make them up to date on current events (and has obvious alternative sources), or the actions of the start up space which don't already have such datasets.