> a human mises a cancer, that 10 out of 10 radiology models say it's there with 99% confidence

I think the cases where judgements differ—either between humans or AI or both–will be the difficult to discern cases, where no human and no LLM will have 99% confidence.