What matters is relative to one's perspective. Nothing objectively matters.
Nobody's saying everyone is of equal value, they're saying that reducing your perception of somebody into a 2-dimensional caricature because you don't perceive value in them is the type of disgusting mental habit of somebody who either has no real friends or soon will have none.