I think the argument against taking money from him centers around influence.
Taking money from someone is perceived as them gaining influence over the opinions and actions of the person receiving it. When the person donating is a "bad person" then they are a bad influence and taint the receivers actions also.