You can teach a human when they make a mistake. Can you do the same for an LLM?