Ars Technica content is now available in OpenAI services
arstechnica.com
arstechnica.com
plus there's a high likelihood they were scraping and cleaning this data anyway. a formal agreement puts that effort on the publisher's side, letting them cut cost, complexity, and the potential for bad data.
This is a key point. OpenAI is getting guaranteed non-AI generated text data; which is slowly becoming a very valuable resource. You can expect that future LLMs may not require trillions of tokens of text data to generalize if generalizability is picked up better by future model techniques (which IMO would involve picking up general pattern recognition via non-textual data too (i.e. other modals of the current multi-modal and beyond such as puzzles)), and thus even just millions to billions of tokens via high quality sources like news publications, books, and research papers, will be highly worth it.
Also, the SearchGPT integration for latest news is also a plus point. Think of all of those all-you-can-read news subscriptions such as Scroll, but that instead of paying for it that instead paying for SearchGPT covers not just a high quality search engine but also the dues to the news publishers via such payment (via these partnerships) from OpenAI to the news publishers.
AI training is an expensive and computationally intense process that happens rarely, usually prior to the launch of a major new AI model, although a secondary process called "fine-tuning" can continue over time. Having access to high-quality training data, such as vetted journalism, improves AI language models' ability to provide accurate answers to user questions."
I'd challenge: inefficient compared to what? For many tasks, the only more capable systems we know of are biological ones that evolved on 4 billion years' worth of data followed by years of constant input from all senses. Gradient descent is incredibly fast and data-efficient by comparison (hence use of mutation + natural selection for machine learning is mostly limtied to tiny toy examples).