You’re right but that’s basically an ad hominem.

> of an argument or reaction directed against a person rather than the position they are maintaining.