It's as much up to me as anybody else. I won't be discounted because you think I don't have the right skin color to have a valid opinion.
> There is something resembling a consensus among black people
I doubt you have any reliable way of knowing whether your claim is true, but it wouldn't matter if it was. I simply don't respect your, or anyone else's, racist notions about what skin colors entitle the wearer to say certain words, any more than I would respect racist notions about who gets to use which drinking fountain.
I have no desire to say that word, but if I want to use it, I will, as is my right as a human, and if someone wants to persecute me because they think my skin color does not authorize me to that word, that is their own racist, neo tribalist, re-segregationist thing, and nothing I've done wrong.