"The criticism is bad, therefore the claim must be true" certainly sounds like a rhetorical fallacy to me. Does it have a name?
This kind of thing was everywhere in the Trump era: whether you were on the right or the left, you could easily navigate yourself into a space where all of your critics were random people who were obviously completely unhinged. They don't actually tell you that your position is all that great in any strict logical sense, but they certainly are emotionally affirming!