To be fair, this isn't a ladder OpenAI used themselves, right? (The seemingly-extreme shortcut of training from an external LLM model)
Their ladder (using public data, and hiring humans to classify to taste) is still available I believe.
Their ladder (using public data, and hiring humans to classify to taste) is still available I believe.
Not really. Once chatGPT came out, many sites changed their terms and/or significantly increased their API access costs to prevent/limit/make cost prohibitive future scraping.
I had assumed most of their web content was from Common Crawl, and the older pre-ChatGPT Common Crawl datasets used would still be available. But it looks like Twitter, for one, was not in Common Crawl.
Which is not openAI “pulling up the ladder behind them”
There is literally no way for them to avoid looking like assholes once they take enact barriers that they themselves did not have to overcome.
As far as we know.