They have been RLHF (reinforcement learning with human feedback) tuned.
In essence they've been fine tuned to be able to follow instructions.
In essence they've been fine tuned to be able to follow instructions.
RLHF trains a model to adjust it's output based on a reward model. The reward model is trained from human feedback.
You can have an instruction tuned model with no RLHF, RLHF with no instruction tuning, or instruction tuning and RLHF. Totally orthogonal.
Nearly all popular local models are instruction tuned, but are not RLHF'd. The OAI GPT series are not the only LLMs in the world.
At least we have this needless nerd snipe so others won't be potentially misled by my careless quip.
Sorry if it came off as more than looking to clarify it for folks coming across it.