Not true. There's plenty of easy ways to update the weights if you want to do that.
You could for example DPO based on another LLM's evalution of how a conversation is going, or you could use whether the conversation keeps going.
You could for example DPO based on another LLM's evalution of how a conversation is going, or you could use whether the conversation keeps going.
You can update the weights based on a single point of data (response was bad) but you probably can't usefully update a model that way.