Maybe the former is not completely kosher, but the degree is so different that it makes zero sense to accuse someone of not calling out double standards when they mention the one and not the other. Also, it is really silly to tell activists that they aren't allowed to bother you until they have sufficiently bothered everyone else to your satisfaction. Basically all you've done is ask them to go away. It is morally equivalent to saying that people are not allowed to worry about healthcare or the homeless in their own country until the Africa problem is fixed. It's dumb.
Also, plenty of feminists are complaining about the representation of women in fashion. So on top of being bad rhetoric, your objection is wrong on the facts.
> I love women and I have a lot of female (and male) friends
If there was a website called "x-ist-tropes.com", "I have X friends, my mom is an X" would be the #1 trope for almost any value of X. Just don't say it.