Wasn't the controversy more about how the shirt was perceived by randos on twitter, not by his colleagues?
If a black friend gives me a shirt with the N-word on it, that doesn't mean I should wear it at work.
Ultimately, it's up to the guy wearing the t-shirt to make a judgement call as to whether doing so would offend or not offend his friends and colleagues. So: context, relationship with everyone else at the place he works at, balanced sensitivity etc.
If he honestly (not deliberately) makes the wrong call, he should apologise and everyone should move on. Work is a place for adults, not children on a lynching party.
http://realfunny.net/picture-3097-these-two-friends-wearing-...
They probably don't wear the shirts to work.