The purpose of evidence is to provide support for a claim. However in colloquial speech we generally speak of someone having "evidence" of something when they have absolute proof.