You’re wrong about the benefits a company and its workers enjoy from specifically protecting itself against allowing in the animus that exists outside the workplace. Being an inclusive workplace which goes out of its way to accommodate minorities carries a small price — but pays excellent dividends. Doing this in no way would alienate any prospective employee — except a person like yourself, which seems 100% okay to me.