The LLM will apologize for the mistake, tell you it understands now, and then proceed to make the exact same mistake again.