How someone looks informs your prior probability of who they are. What they say informs your posterior probability, but you gotta take that prior into account when forming the posterior. At least, if you want 'accurate' statistics.
(Bias - variance trade-off not withstanding, nor second-order effects of doing the 'correct' thing being possibly more detrimental than the advantage given by the 'correct' thing)