However, in normal speech racism is defined as believing that human are separated into different races and that there is a hierarchy of superiority, usually with your own race being on top of it.
There is nothing wrong with helping usual target and/or victims of racial or other hate to offset the potential effects said hate. Unless you of course believe safe shelters for women are inherently sexist. In which case you are just old fashioned rasist slash chauvinist.