Colonizers gonna colonize. I don't believe your "oh you weren't nice to me, this justifies my arrogance", you'd feel justified anyway. But you aren't.