I think as a society we should always strive to be objective, especially when accusing someone of wrong-doing and, subsequently damaging their lively-hood. Yes, Black Americans have life experiences that tie extreme emotion to this word, but I think we can recognize that without losing sight of objectivity.
There is a reason we don't allow police officers with personal involvement to investigate crimes, and why it's generally frowned upon for employers to date their employees. It's the same reason why we shouldn't let the most subjectively affected decide intent in this instance.