This argument can be used to justify whatever actions you want. You know that, right?

For example, I'm gonna take your house and when you ask why, it's because "life isn't fair".

However, various forms of fairness to balance out past wrong doings can always be achieved if desired, but it usually requires force or democratically if over 50% of people can unite on it.