True, maybe a factor of RLHF then? I wonder if anybody has tried asking this to a base model or a jailbroken model…
But still super weird they all converged on the same thing. Still curious as to what a missing common factor could be! Same agency in Kenya they outsourced their RLHF to?