Summary: Ad Hominems can be factually correct yet they are still Ad Hominems and still the lowest form of disagreement.
And my point in this case isn’t that the entire argument was an Ad Hominem, but rather that it was a (possibly correct) Ad Hominem followed by a perfectly reasonable point. I stand by my assertion that the point is stronger on its own without the Ad Hominem.