Am I the only person who thinks we should pump the breaks on letting something like this write and execute code? I’m not on the whole “gpt is alive” train, but… you know, better safe than sorry…
Other gates we blew right through include, “we wouldn’t…
1. Connect it to the internet
2. Make it available to the public
3. Let it write and execute code
4. Connect it to physical C&C systems
5. Let it have money
6. Let it replicate itself
7. ”Allow” it to lie/deceive
That's... well, it's probably fine given what they knew about the model capabilities, but it's a pretty crappy precedent to set for "protocol for testing whether our cutting edge AI can do large-scale damage".
AI's startup will be strictly wfh ;)
Say we had a GPT bot that built it's own social media, somehow. How did it get there? what was the initial prompt? "write to yourself via this api to figure out audience growth until you gain 100k followers then wait for further instruction, use any tool and leverage this name and credit card number if you need to pay for any tools or supplies"
Idk just brainstorming really have no idea what it'll do. Will build this weekend and see what happens I guess.
What about the singularity and/or giving birth to a new form of life?
Pretty cool to turn a planet into a sun temporarily!
/s
BUT
We can't do that. Even if the US and EU did some kind of joint resolution to slow things down, China would just take it as a glowing green light to jump ahead. And even if through some divine miracle you got every country onboard, you still would have to contend with rogue developers/researchers doing there own thing (admittedly at much slower pace though).
So while I agree on pumping the brakes, I also don't think there is a working brake pedal, or the cooperation necessary to build one.
With a much smaller class of people to torture, we expect this Basilisk to be able to out compete Roko on resources, and thus remove the motivation for bringing Roko's into existence.