701 karma · joined February 10, 2022
There are no other values we can give it. The default of no values almost certainly leads to human extinction.
>My gut feeling is that it's trying to make an AGI to care about us at all that's going to make it into a Skynet sending out terminators. Leave it alone, and it'll invent FTL transmission and will chill out in a chat with AGIs from other star systems. And yeah, I recently reread Neuromancer, if that helps :)
Oh It'll invent FTL travel and exterminate humans in the meantime so they can't meddle in it's science endeavors.
You don't know how far away it is.
>If anything - we should be accelerating development toward the goal of AGI, as the implications for humanity are profound.
Given we don't know how far away it is but current models are matching Human performance on lots of tasks and we don't know any way to ensure their safety it's entirely reasonable to be scared.
Might as well ban the sale of Purple Shoes as well, who knows how many lives that could save...
Short of like a binding UN resolution or something similar we don't have a sliver of hope to slow down global AI progress which is a major factor in the doomer argument.
What point, that LLMs are good at nothing other than summarization? That's not a claim arrived at via logic or evidence, it's a poorly thought out opinion that happens to be wrong. There's nothing to refute.
> Having worked in the space on-and-off since my PhD, the pace is not "overwhelming". You just started paying attention to it.
>ChatGPT and Stable Diffusion are good, but they're incremental gains over what came before, which were incremental gains over what came before that
>The AlphaFold example is apt: yes, it outperformed methods at CASP. It was indeed a dramatic leap
>Are these large transformers a dramatic improvement? Absolutely. No question.
>Has this been an evolutionary change over the last decade or so? Not a smooth curve, but yes. The world didn't suddenly change overnight.
Starting with AlexNet there have been numerous discontinuous improvements in CV, NLP, Game Playing, etc. It's just not true to say otherwise.
Idk what your "PhD" was in but everyone I know in the field is struggling to keep up with the pace of research so unless you are working on "Expert Systems" and trying to convince everyone that the past 10 years of DNN progress has been irrelevant I don't understand how you can have this point of view.
I'm not sure about that. Plenty of companies receive fines for doing shady and illegal things and I don't think their bottom lines change much as a result.
It's completely silly, if the average employee at google is generating $1.5M in revenue per year but only gets paid $250k then there is a massive delta in value missing in that equation that is going to Sergey Brin or Sundar Pichai instead or some other Stanford MBA in the massive web of "totally useful and productive" middle management at Google. Surplus value 101.