This is part of the problem with things like this - while good intentioned, it inevitably alienates another equally oppressed group.
Why can't we just have "Office Hours" and make it absolutely clear it's for anyone -- and actually follow through with the intent.
It just seems silly to says "these here are for only this one small group - and that's how we're going to help combat bigotry".