This applies equally to whites and people of color, rich and poor, nationalities, and more. I have yet to find a culture that didn't have both problems and benefits when you generalize about them.
I've also yet to have that generalization be actually useful when evaluating an individual.
But I have to ask: If I stop someone from discriminating against you, with or without your knowledge, is that really "destroying your culture"? If I'm in a meeting and stop someone from ruling out a potential candidate because of skin color, did I harm their culture?
I can't see how that's possible.
I could see how "culture" changes over generations as economic status changes. But I'm certainly not going to refrain from helping someone because I think there's a chance it'll change the culture of their grandchildren.
That said, I've been in situations where I could "help" someone avoid some racial prejudice and was asked not to by that person. As they wished, I did nothing. I didn't like it, and I still wish I could have helped them, but I felt I had to honor their wishes first. (The person I'm thinking about eventually quit from stress and moved out of state.)