Humans can’t agree on what is ethical / safe, so I don’t get people trying to apply it to AI. Am I missing something big here?
Anytime I see discussion framed as “ethics” my brain swaps ethics with “rules I think are good”.
Anytime I see discussion framed as “ethics” my brain swaps ethics with “rules I think are good”.
Like, murder is bad, and some people disagree. Don't think that means we need to give AI access to murder. Certainly don't want to be giving them any guns.
The danger here is that we fall into a lazy "we tried nothing and we're all out of ideas" stance and then just recreate the entire plot of Terminator. We should probably do something.
As in: it's basically a nice happy accident that LLMs are only sycophantic/fawning and don't normally (ahem, Grok) try to undermine us all like edgy internet trolls.
If we could make them follow even exactly 6 (for sake of argument, no more, no less) of Anton LaVey's Eleven Satanic Rules of the Earth*, and do so reliably instead of the ethics equivalent of a shrug and "LGTM, merged", this would be a big development and make people a lot more comfortable about open models that can do decent work with chemistry or biology.