Out of curiosity, would you be ok with someone telling a non-us citizen black man in the US "If you don't like people acting racist toward you, go back where you came from"? That is fairly widely considered inappropriate in the US (though not universally).