This is about first impressions without knowing the person. If one group has it substantially easier than another, you question that group that has it easier not harder.

Since the white guy was the diversity hire here, I might, yes. But that's not usually the case, as I'm sure you know.