Two years ago or so, I met and spoke to people whose offices were down the hall from his at MIT. Their stories line up perfectly with the accusations against him. Just because you weren't aware of his awfulness doesn't mean it didn't happen.
I heard about advice given to some women to keep plants, so that he does not come. But that is not the same as story about Stallman harassing someone, it is story about people thinking he is creep, but no specific on anything he was supposed to do to women without plants (hope the difference is clear).
You are repeating defamatory rumours without a shred of evidence.