If you removed all racists from the economy, black people as a demographic would still be at a huge disadvantage for a very long time (or forever?). The playing field might not level on it's own.
If a system starts out with biased functions and runs long enough so that the distribution of the state is biased, removing the biased functions doesn't necessarily guarantee the state will return back to an unbiased equilibrium.
Removing explicitly racist laws doesn't remove the biases embedded in the system from two hundred years of slavery and terrorism. There is a complex feedback loop of education, economics, and cultural attitudes that have locked the imbalances in.