The inequity resulting from the material consequences of appearing in, being raised in, and interacting with society as white and male is a well-established statistical fact.
And more centrally, whiteness (in particular) and maleness are still not facts. You're in voodoo territory if you center them as such.
I fail to see the nit you're picking at with that second bit. Are you saying they are categories? Suppositions? Made up? Do you mean to imply then that they are "spooks" and their presence in the minds of physical agents has no bearing on physical outcomes?