Not sure I would ever trust the safeguards enough to think this would really be a good thing.
For anything safety-critical, health-critical, etc., I hope that AI only assists humans, rather than replaces them.
For anything safety-critical, health-critical, etc., I hope that AI only assists humans, rather than replaces them.
When I see physicians like Lynn Webster prescribing insane doses of Oxycontin for any injury, ignoring the warnings of the people dealing with the disastrous results and finally making up excuses for the death of his patients, I am pretty sure a lot of families would have preferred to take their chance with IA.
But of course, a fully utilitarian society would probably be a nightmare.
I imagine it is a mix of an illusion of control and "it won't happen to me because I drive better than the average driver".
Safeguards are fine if you know what to safeguard against.
I suppose neither a human doctor nor an AI doctor should be "obeyed"; they are both there to assist the patient, not to control the patient.