And what happens when the defense AI 'hallucinates' and suggests that somebody is a terrorist when they are not?
Collateral damage. Same thing that happens in any war when an analyst or soldier misreads the battlespace.
War is hell. We won’t change that by making it pleasant. We can only avoid it by not going to war.
So what will happen if AI suggests someone is a terrorist when they are not? Well, in the worst scenario they'll be killed, and it'll be very close to what we have today, except somewhere in a private military database there might be an automatically generated record from an LLM ok-ing the target.
https://www.theguardian.com/science/the-lay-scientist/2016/f...