Are these uncensored or decensored? If rlhf removes intelligence at any rate, I wouldn’t expect that intelligence to come back with a tune that’s let’s it say curse words and talk about religions
It will be happy to curse, talk about religions, help you cook illicit substances or do all sorts of other stuff.