I haven't heard that argument since I was a teenager, would any serious adult today use the argument that we shouldn't use tool X because other people, including people we don't like use them?
Also, that’s big media’s claim against torrents. And the war on drugs started by Harry Anslinger was basically started along those lines.
It seems “percentage of use by people we don’t like / for purposes we don’t like” plays a big part.