In much the same way that Teslas are still literally killing people when they encounter vehicles parked across roadways in 2023, just like they did back in 2016, the difference between the appearance of understanding and actual understanding is a much wider chasm than it first appears.
The LLM will not "consider" anything. Even transcripts we've all seen in which LLMs seem to acknowledge errors (rather than doubling down and inventing false sources) are still just text-prediction, modeling what it would be like if someone acknowledged an error.
When a particular LLM seems to take the corrections offered in a widely-publicized transcript on board and not repeat them in future transcripts, that's because someone acted to modify the model, adding filters or weights to ensure that the text prediction path goes differently in the future.