Security and morality may need to be baked in from the ground up instead of slapped on after the fact RLHF style. The problem is it’s hard to codify (or reach consensus) on security and morality.
I can choose the level of safety I want in my results. With a very coarse granularity, but I choose it.
I don't want to take a huge step backwards to where I can't make this choice.
I'm not saying safety rails are bad, just that I, the user, want control to ignore or override safety rails according to my own judgment.
You can certainly do you're own feedback on a base model, matching whatever form of "safety" is right for you, but the idea you have a "right" to something else is precisely what I am saying. You want to see the same movie, but with "your" morality.