It's a reflexive guilt-by-association instinct that many people have. Some people have used crypto in the past unethically, therefore everyone using crypto is unethical. I usually like to illustrate the problem with this fallacy by using it in a way that nearly everybody can quickly see: "do you have a dog? Hitler had a dog."