[1] that's mortality rate which I am using as a proxy for incidence rate, though the actual incidence rate is presumably higher (mortality rate from the CDC)
After this test you now have updated priors which may not be good enough to make a certain diagnosis, but wouldn't it still be useful combined with another independent test that has similar rates, since you'd be using these updated priors?
That alters the Bayesian priors quite a bit.
In addition, you can monitor the progress of someone who "tests positive" over time and see if that is really true.
Part of the issue with Alzheimer's treatments is that we may be intervening far too late. These kinds of tests may help that.
Meaning, 100% of positive cases in the test set were correctly identified, and 82% of negative cases in the test set were correctly identified. That corresponds to a 0% false negative rate and an 18% false positive rate. The test set is 40 imaging studies from 40 patients.
There are medical tests which have such a high rate of false positives that in practice in the absence of other indications you would ignore a positive result, because the only possible follow-up test would be a non-risk-free biopsy, and therefore, for your peace of mind, it's probably better not to do the first test at all.
Other commenters have noted that the sensitivity is 100% with specificity 82% (false positive rate being 18%). I wanted to provide my own take on what that means for me as a future provider (I'm considering becoming a neurologist after medical school). I'm assuming to the data science crowd here, it's almost second nature to know what these numbers really mean in practice, but maybe I can provide some outside perspective.
When considering screening tests in medicine, we have to always balance the benefits and risks of conducting these tests on patients. We have to figure out how reliable a test is, and how patients benefit from earlier detection.
In this case, it's an imaging test, so noninvasive. However, it's a test that requires radiation (positron emission tomography or PET). So we already have to determine if that extra radiation dose is worth the increased risk for something like cancer. In an elderly population, it's almost certainly worth the scan given the radiation would not significantly impact their decades of accrued radiation damage.
Now, what happens if a patient has a positive test, 6 years earlier than they would normally? Let's assume for a moment that it was a true positive test. They could receive treatment earlier, which could improve their quality of life. They could adjust their risk factors to slow down the progression of disease. The treatment could have side effects, such as increased blood pressure. If we apply that to a large population scale, would we increase mortality associated with heart disease by treating patients with suspected Alzheimer's earlier?
Lastly, I wanted to touch on the effects of a screening test with a large amount of false positives. I would argue that a screening test should be allowed to have lots of false positives, simply because we can always do other tests (neuropsychiatric evaluation like MOCA score) to improve our accuracy of detection. However, if we do these other tests, we have to again balance the harms with the risks. Mammograms, for instance, could give false positives that could warrant a breast biopsy. In the case of Alzheimer's, a false positive could lead to stress and depression in an elderly population already at higher risk for stress related disease.
In short, screening tests are great if there's a way to do something about the disease. As far as I know, early prophylactic treatment (with current medications) of Alzheimer's does improve quality of life, slowing progression of the disease manifestations, with relatively few side effects.
There's plenty to delve into regarding the risks and benefits of screening tests: Here's a good framework for those interested.
public bool HasAlzheimer(GlucosePetScan patientScan) { return true; }