Us, 2023: let's let this ridiculously complicated inscrutable neural network install Python packages and run user code. But of course it has access to the entire internet and is exposed to the entire public. Derp derp derp.
Us, 2023: let's let this ridiculously complicated inscrutable neural network install Python packages and run user code. But of course it has access to the entire internet and is exposed to the entire public. Derp derp derp.
It seems like OpenAI was the catalyst for all of big tech to jump on the LLM bandwagon.
But the speed at which new models have been produced has been so fast that it also makes me think perhaps at least some of these non-OpenAI models would have been developed and released even if OpenAI weren't a catalyst.
(Getting on a tangent, but..) one thing I've never fully understood is why or how LLM's suddenly emerged seemingly all at once. Were the development of the models we have today already well underway in 2022, or are the majority of models created in response to OpenAI popularizing LLM's via ChatGPT?
If the meteoric rise of ChatGPT didn't occur but the technology still existed (but less well known), there would be no "gold rush" type of environment which might have allowed companies more time to get better polished products. Or even purpose built models rather than huge generic ones that do everything and anything.
GPT-3 made a number of us really start wondering what was going back on in 2020, but probably due to covid it was missed by a lot of people. Lots of people work working on things like GPT style models with RLHF, but OpenAI was way ahead of the game.
What a dumb dystopia.
Yes it is. Or it very well could be. Agency is trivial to implement in LLMs.
https://github.com/microsoft/autogen
https://arxiv.org/abs/2307.07924
The intelligence and tool access of the LLM in question is the only thing stopping things from being particularly dangerous (to humanity).
A snowflake is harmless. A million of them and you might freeze. And a trillion of them may bury your entire city under an avalanche.
Add in the AI-effect where when we learn how something works it's no longer AI, and eventually we'll get to the point of having super capable 'intelligent' digital systems where a huge portion of the population is in denial of their capabilities.
And the GP was clearly referring to such a system, so insisting that it's just a book seems, charitably, off topic.