This is a really good point. Empathy can be applied to judging moral crimes such as stealing food becuase you are starving. Although anctedotally I find that people who come from the exact background/situation tend to have less empathy even though they understand the context more.