I don't believe that's the issue here. I believe the concern is their response is more valid because of the group they're in, not that they're responding as a group or as a member of the group.
Just look at any minority who doesn't buy into identity politics. They're labeled as traitors, haters of their own race, or trying to play cool with the other side ("cool girl" within feminism).
This is the problem with identity politics. Because you look a certain way, you must think a certain way.