>>>"You could for example DPO based on another LLM's evalution of how a conversation is going,"
You can update the weights based on a single point of data (response was bad) but you probably can't usefully update a model that way.
You can update the weights based on a single point of data (response was bad) but you probably can't usefully update a model that way.