I think people just look at the price and assume it must be terrible, somehow.

Fast fashion gets a bad rap because of the assumptions about consumer behavior and labor. Almost all clothing is terrible for the environment and for the people manufacturing it, anyway. I have many H&M items that are nearly a decade old and are still wearable.