The issue with adversarial examples is defending against a wide class of examples, not a few specific images.
Clothes change much slower than software updates, and defending against a few adversarial examples is relatively easy, so this shouldn't be a problem.