Human indifference isn't a binary state. I can drive around in a big SUV, doesn't mean I'm indifferent. All the people in the world can't, nor are obligated to care exactly as much as you do. Telling people otherwise is just moralising.

Humans are a subset of the universe.