Can't those LLM/text-to-image model rules be embedded in the training/alighnment process instead of being injected before user input?
Can't those LLM/text-to-image model rules be embedded in the training/alighnment process instead of being injected before user input?
People have this idea that Asimov envisioned a world where robotics was based on the rules, but it's the opposite really. He was claiming that there is no such thing as absolute rules once intelligence starts getting involved, and that nuance and grey areas are inevitable. The three laws were never more than a straw man to be taken down, and it's really weird to me whenever anyone uses them as some kind of north star wrt/ to AI ethics.
So in that sense, the comparison is definitely apt :)
Absolutely. The model would fairly easily learn these rules with enough training even if you don't include such prompt.
But the prompt helps with training stability, and with not hurting other tasks.
In reference to the Three Laws, see also GATO framework: https://github.com/daveshap/GATO_Framework