Yeah, absolutely. In fact, I've worked with a few people with animosity toward my race. I don't prefer it, obviously, but so long as they're not taking action based on it, sure, why not? Part of living in the world is dealing with people.

If they make threats or disrupt the work, sure, that's over the line. That's true regardless of their motivation though.