That's not a very good argument. Putting aside the present topic, this argument doesn't address the substance and instead lazily falls back on an association fallacy: "if people said P about A in the past and we no longer think that, and you say P about B, then you must also be wrong". It's the same kind of progressive argument people use when they categorically dismiss any criticism of new music as just the same old hate old people always have for "new things". Boring, dismissive, unthinking, and refuses to consider that there might be valid criticism apart from the crankiness that does, in fact, exist. It assumes as a premise that art cannot be bad, or that it cannot be an expression of cultural decadence, whereas I claim that it can.
And I would actually claim that most Warhol is trash, good swaths of Dali worthless, and both Matisse and Gaugin mixed bags.