There was no actual punishment to the slave owners and they've ingrained their grievances about having to work into every generation since. If there's no punishment coming it will just continue the cycle of racists wanting to be lazy but reap all the rewards because of their skin color.