I would love to hear opinions from LLM experts. But I have a feeling they may not be able to update the model, at a fundamental level, so easily by live feedback.

Based on what I have been reading, training the core model is a work of statistical analysis on how often words follow each other. This produces a graph tree of words.

Now how do you re-evaluate the entire graph based on a single additional feedback without actually retraining the entire model with the said feedback (because it is costly, and result wouldn't be immediate, unless you're thinking of injecting the input as an initial condition to the readily trained model)