Interesting POV. Many today who oppose DEI are indeed racists - I think that’s clear. But some opponents may be unaware of the pervasiveness of systematic racism, or might differ on the best way to address it, or may have other reasons for their beliefs - reasons that probably aren't all reducible to racism.
Just because you don't know you're being racist doesn't mean you aren't being racist. That's what systematic racism means.