To take the most glaring example: "my point is true because my point is true". Obviously, nobody actually says this seriously. But some arguments are isomorphic to this. And any argument like that is not wrong per se--it is literally meaningless.
Other fallacies are more subtle and complicated, but the idea remains the same: using a fallacy does not invalidate your point but merely renders your argument meaningless. I can say that "the sky is blue because everybody says so" and I would not be wrong--given the sky is actually blue, of course--but the argument would still be a fallacy. I think to point this out is valuable even (perhaps especially) if you do not disagree with the point in question.