There is a lot of hand-wringing in this article, with no reasonable attempt to discuss the balance between possible benefit and possible harm to the patient.
A lot of the paper argues that there was no direct care relationship between deep mind and each patient, and that the data transfer was therefore inappropriate. I disagree, and think in the future we will see many algorithmic systems involved in direct patient care. After all, you could pay an army of clerks to review the notes and results (I.e. patient data) of every patient at the royal free hospital, run it through an algorithm (paper flowsheet), then notify the doctor that there might be impending acute kidney injury, leaving it to the doctor to make the clinical decision about whether there was in fact AKI (true positive) or not (false negative), like we do with EVERY piece of information we get when assessing a patient. That could have been done any time in the last 100 years, without anyone being concerned about the appropriateness of it. Deep mind was essentially doing the same thing on behalf of the doctors at the hospital. The risk of harm and the regulatory framework should certainly be considered and developed, but it has to be weighed against the potential benefits, same as every other medical advance (and setback) in human history. Listing a whole bunch of potential dangers is an easy way to write an article that gets attention, but I’m more worried about articles like this unreasonably impeding progress in the field of “algorithmic medicine” than I am about Deep Mind and the Royal Free’s approach to this, at this exploratory stage.
I would feel differently if there was an identifiable business model that conflicted with the interests of the patient, but I think at this super early stage we should err on the side of exploration, not restriction.