Lots of people contribute nothing to racial harmony over their lives and yet they'd be sufficiently politically correct that you couldn't call them racist or ex-racist.
Gandhi ended up having undone the damage to an incredible, extraordinary extent. I'm no Gandhi fanboy, but I don't see how the hint of blame that 'ex-racist' implies can be applied to his life.