If I haven't looked in my desk drawer, this is not evidence that it's empty. It's only evidence that it's empty if I open it and don't see anything.
Or, put another way: The real world isn't boolean. A and Not-A are not the only options; there's also "I don't know."
The last case there is what's generally referred to when people say that absence of evidence is not evidence of absence.