this is basically the “angry black man” defense - just because some people aren’t protesting in a way you approve of doesn’t mean it’s ok to hate the group indiscriminately
But yes, if the activist community fails to disassociate itself from / speak out against radicals who are harming people, then that activist community is going to receive criticism.
I sort of agree, in that the groups are composed of individuals and it's not entirely fair to hold them responsible for things they didn't personally do. I also think if you see a political community as having some sort of problematic culture it's reasonable to say so.