The phrase is also commonly used in the sense of an "ad hominem attack", meaning an attack directly on a person's character or actions, rather than their work or ideas. It doesn't always refer to the fallacy.