Supporting the racists because you think it's better for your wallet is still racist. Supporting policies that hurt POCs disproportionately is racist even if you don't understand why.
When someone points out something is racist, is your response to explain why it isn't or change?