Its not really privilege, you probably just have no immediate people in your life you care a lot about who are fearing for their freedom in the next four years.
That isn't a negative personality trait either, we cannot as a people expect anyone to have empathy for a group they have no personal ties to, especially in contrast to real threats against themselves.
Both are problems, it is just those who are in danger of suffering from Trump's racism / xenophobia / sexism and their immediate peers see that as the more immediate threat, because he can undo decades of civil rights and equality in the first days of his presidency.
He can set in motion programs to destroy the climate more in the first days of his tenure, but it will take years to suffer the consequences of them, even if they are much more permanent than immediate regressions in liberty. For individuals, permanence does not matter - your time is limited, and everything Trump takes away represents days or years you will never get back of oppression.