Let's say you have two advisors constantly giving you advice about what action to take next, and all you ever do is choose between them. Over time you might learn that one of them gives better advice in some situations and the other gives better advice in others. In this weird hypothetical, regret is noticing that you followed the advice of the wrong advisor for the situation, and it turned out especially poorly.
What's going on in your brain is a lot more complicated than this, but I think it's still a meaningful concept?