If "he didn't take it to court" is the strongest argument that the claim is true, that seems weak to me. I'd invoke "absence of evidence is evidence of absence" in that case.