1,231 karma · joined July 26, 2016
It’s a fine joke, but deep down the instinct is very top-down and suggest centrally planned economies, dare I say communism!
The main hard part of searching isn’t formulating queries to write in the Google search bar, it’s clicking on links, and reading/skimming until you find the specific answer you want.
Getting one sentence direct answers is a much superior UX compared to getting 10 links you have to read through yourself.
I totally agree with your sentiment but I think “more free time” is a difficult award in general. Most managers would probably look at most high performers and say “you want more time? Then work less! You are already over performing” it’s somewhat out of their hands how much someone chooses to work, but they can more directly control how much they pay and award via bonuses.
Apple published the rules for their App Store over a decade ago and has largely stood by them so Apple is not being punished.
The model is a static data file like a word doc.
Meta open sourced the code to run inference on the model (ie the code for Microsoft word reading a doc file).
They also open sourced the code to train/fine tune the model. (Ie the code for Microsoft word writing a doc file)
Then they released a special doc (the llama 3 model), but didn’t include the script they used to create that doc.
Now, if cost is little concern you can use zero shot prompting on an inefficient model. If cost is a concern, you can use GPT4 to create your golden dataset way faster and cheaper than human annotations, and then train your more efficient model.
Some example NLP tasks could be classifiers, sentiment, extracting data from documents. But I’d be curious which areas of NLP __weren’t__ disrupted by LLMs.
Here's a hypothetical: suppose there is a random fact about some news event that has only been reported in a single article. Do they suddenly have a monopoly on that fact, and deserve compensation whenever that fact gets picked up and repeated by other news articles or books or TV shows or movies (or AI models)?
I agree. You can even listen to the NYT Hard Fork podcast (that I recommend btw https://www.nytimes.com/2023/11/03/podcasts/hard-fork-execut...) where they recently had Harvard copyright law professor Rebecca Tushnet on as a guest.
They asked her about the issue of copyrighted training data. Her response was:
""" Google, for example, with the book project, doesn’t give you the full text and is very careful about not giving you the full text. And the court said that the snippet production, which helps people figure out what the book is about but doesn’t substitute for the book, is a fair use.
So the idea of ingesting large amounts of existing works, and then doing something new with them, I think, is reasonably well established. The question is, of course, whether we think that there’s something uniquely different about LLMs that justifies treating them differently. """
Now for my take: Proving that OpenAI trained on NYT articles is not sufficient IMO. They would need to prove that OpenAI is providing a substitutable good via verbatim copying, which I don't think you can easily prove. It takes a lot of prompt engineering and luck to pull out any verbatim articles. It's well-established that LLMs screw up even well-known facts. It's quite hard to accurately pull out the training data verbatim.