The reason he was (finally) banned from Twitter was for encouraging his racist supporters to harass Leslie Jones and send her gorilla memes (a wildly racist trope, as you know).
Proof? I've always heard it insinuated that the instructured his followers to send her gorilla memes but the only thing I've seen Milo say about Leslie Jones was that she looks like a former male sex partner of Milo's.