I think it is hard to make that into a constructive argument.
Either you care and the 'allocation' is unfair.
Or you don't care, which means that the market doesn't work since you caring is what is supposed to allocate resources fairly, and it is still unfair.