US will say "no" to global ban on killer robots
newsweek.com
newsweek.com
And the UN has repeatedly proven it does not have an effective enforcement mechanism.
Nuclear proliferation is enforced at gunpoint by the nuclear powers.
As for chemical weapons, "they are dismantling these systems because they do not expect they will ever have a use for these weapons. Not because chemical weapons are immoral. Because they are ineffective, whereas landmines, cluster munitions and nuclear weapons are assumed to have future uses. Morality was never at issue, effectiveness was" [1].
[1] https://acoup.blog/2020/03/20/collections-why-dont-we-use-ch...
About all UN enforcement in general, how about I just let the UN GA talk: they voted, again, yesterday, on legally preventing anyone from taking action on human rights. In case you think you didn't read that correctly, yes, PREVENTING:
https://docs.un.org/en/A/C.3/81/L.30
As the UN's own document notes extensively, they have done this vote for 40+ years.
As for nuclear specifically, are you serious? That must be why the UK, France, China, and Russia are helping so much in the US's war on Iran! (and how they stopped China in the 1980s, and ...) (and please don't repeat "but the nuclear deal" Iran was caught TWICE, by the UN, having violated it, and I don't think the US negotiators were lying in the article about how Iranian negotiators were boasting about violating the nuclear deal in Oman, nor do I believe that Trump blew up the nuclear deal out of ego). Just about the only real enforcement the UN does is provide a neutral party to check nuclear proliferation (or should I say semi-enforcement. After all the UN has voted many times to call the IAEA a conspiracy)
We have very publicly chosen to abandon the security architecture of the 20th century. Everyone has, Russia and China, obviously, because they want to attack. But Europe, including the European nuclear powers (yes, France was a bit of a holdout, as they were after WW2), have abandoned largely enforcement on nonproliferation ... and on human rights. In fact if they do anything it's sanctions, and sanctions are both very self-serving and have proven to be utterly ineffective, for many reasons, and the European powers have not changed tactics (we all know why: sanctions are "free", by which I mean they're more expensive than any other measure BUT don't need budget approval, AND sanctions are extremely good for corruption: for moving business to your friends). And while France held out a bit, US is the last Bastion of NATO, and frankly the last state to actually take action, as in do something militarily, on human rights.
When the UN did act, it was far worse than nothing. Their last 3 efforts (by end date) were Haiti, where an earthquake destroyed the state and the UN sent in soldiers who proceeded to start a cholera epidemic with prostitutes, then abandoned the resulting children. Before that the UN was going to prevent escalation in Lebanon, and (just one example) a rocket was fired into Israel less than 2 meters from a UN military base. Hezbollah killed 4 UN soldiers, and nobody ever faced any consequences. Oh and war broke out. And Mali. War broke out with UN soldiers watching. Everyone wanted the UN to leave. If we look back and look at the first 3 UN interventions it would read similarly.
Again, the US military saved (more or less) the situation in Haiti. The US military intervened in Lebanon many times, which was generally, mostly, appreciated. And as for Mali, France tried to intervene but ran away rather than face the Russian Wagner group.
Oh and of course, the UN is the same buildings, and initially the same people, as the League of Nations. The League of Nations, who negotiated the treaty of Versailles, now generally considered the cause of WW2.
So this is not a new thing.
As for alliances, NATO has held, but it is still under US control (mostly because despite how much Europeans scream they hate US power, or the current administration, or ... they demonstrate regularly they hate the idea that another European power might be in control of their military far more than they hate the US). Other European alliances have outright been betrayed. African and some Asian older-colonial alliances, essentially all of them, most under messy circumstances, have ended. Oh and of course one might remark the Budapest memorandum stated that if Crimea was attacked in any way half of Europe would declare war on Russia. Instead, Ukraine got a few loans (and UK/Boris Johnson gave them the Javelins that saved Kyiv)
Yes, I get I'm going to be downvoted for what will no doubt be interpreted as support for 2 very popular politicians (Trump and Johnson), but whatever.
On what dates, and what "agreement" was violated?
Are you referring to the 2005 UN finding that Iran was in noncompliance with IAEA safeguards that occurred before the first iteration of "the nuclear deal" Joint Plan of Action (JPOA) 2013, and the following iteration of "the nuclear deal" Joint Comprehensive Plan of Action (JCPOA) 2015 ?
And as pointed out before, I believe the US negotiators weren't lying when they stated Iran was actually boasting about their enrichment.
Oh and it's not just the US current political views that are offended with this statement. WHO sold Iran those centrifuges, knowing full well the numbers meant that they were meant for nuclear weapons? The German green party and CDU approved that sale ... but it can't be discussed. I mean, were they deceived? Maybe, probably I'm going to say, but it cannot be talked about and especially the obvious question "What is Germany's responsibility here?" can't be asked.
I mean it's like the Netherland's and Belgium's role in giving Pakistan and North Korea nuclear weapons. There, too, the "... and your plan to fix that, dear Belgium and Netherlands, is what, exactly?"
But it's critical to current political beliefs to say otherwise, half of people are mad enough to deny Iran even wants nuclear weapons, so you're probably about to deny physical reality. Have at it.
Kind of like the "detail" from the Iraq war nobody is allowed to talk about anymore. That Ali Chemicali was convicted of using chemical weapons, first by the UN, then by Iraqi courts, in both cases supported by people standing there with chemical burns. But there NEVER WERE chemical weapons (and certainly not a research program or production facilities) in Iraq. NEVER!
The US politically approved history is as stupid and full of lies as any other countries' history.
So there. Pretty sure I have offended and insulted the preferred political beliefs of a solid 90% of USians and Europeans. Sadly, doesn't make it any less true.
Is that correct?
The simple fact is that Iran cannot be allowed to enrich uranium under any circumstances, deal, no deal, conditions, ... this is political, when push comes to shove it doesn't matters. It cannot be allowed to happen, obviously.
Iran has been under agreement that they weren't going to enrich uranium for longer than the current Iran exists. All Iranian nuclear actions violated NPT, and of course the help they got from Russia and Germany, and the help they gave to North Korea also violated NPT, but that, I'm sure doesn't matter. 1000 violations by Iran, 10 really big violations, and one by Trump/US. Three guesses which part of the list you'll be focusing on ...
This does also mean that the details, AND any blame or who violated what treaty first doesn't matter (cue the endless discussion you're about to start trying to make it sound reasonable what Iran did, it's the "US's fault", right? Or maybe Europe? I've read tankies claiming that. Hell some communists are making the point that if Iran beats the US in this conflict, they'll finally become a true communist state, what they were prevented before by evil Britain capitalist oil companies. Really. An article saying that is on marxist.com). Obviously Iran was the first to violate NPT, both as a principle and as a deal/treaty, but let's say you're right and it wasn't Iran. Or that the JCPOA somehow forgave them and makes everything that happened previously just peachy, which it of course doesn't ...
Fact is Iran has attacked everyone they possibly could, from Argentina to Saddam Hussain, from the Taliban to Norway. Everyone knows what will happen if they get nukes.
Then why did you start this tangent?!
If you want to enforce „anything of anyone” you need a bigger stick than your opponent has.
WHO, UN, EU, all of those pseudo pro human organizations are nothing if China or USA or Israel says so.
They aren't a big enough stuck to make high-value defection work, but this seems to squarely fall under low-value.
I'm all in favor of more severe sanctions, but have realistic expectations. There's good news - Russia is already delaying paychecks to soldiers. Sanctions are having the expected effect. But they aren't going to stop the war.
One, most drone-type weapons are highly dual use. That makes enforcement tough.
Two, our track record with enforcement sucks. Iran has nuclear materiel. (Not a bomb.) Between America, Russia and China we've created a world where middle powers look increasingly naive for not pursuing their own nukes. And I guess if all else fails, have a smuggler sleep with a CEO and then let David Sacks defend them.
Using AI so citizens of your own country don't die in war is probably the highest value add there is... especially in the meat grinder that war has turned into now.
You do realize that the actual enforcement mechanism arises in bilateral relations and through multinational institutions like the EU, NATO, World Bank, IMF, etc.
And it’s usually incredibly successful, especially if the big powers like the U.S. join in.
We all know how that went.
Also that instead to buy expensive killer robots (that can always be used against the population if an insane dictator takes the power), other countries can invest their non-finite resources in research of defense against killer robots. Also in how to scrap each killer robot destroyed for valuable metals and stuff.
For the US, I think the history of a distorted 2nd amendment dialogue may make this even worse: "If the government reserves the right to use autonomous killing drones, then the citizens must have a right to the same!" And the difference between a bot that navigates and carries stuff and a bot that navigates and carries and uses a weapon may be a small modification.
So the question becomes, "Are drones bearable arms?"
Seems to me the answer is an obvious "yes". Since they're small and you can carry them around.
1. https://en.wikipedia.org/wiki/Special_Atomic_Demolition_Muni...
Seems pretty clear in the context of the revolutionary war that the purpose of the 2A was to protect the ability of citizens, or more specifically militias, to overthrow a tyrannical government.
Interestingly this has actually happened once in the USA since the revolutionary war, the Battle of Athens in Tennessee in 1946 (1)! Small scale sure but it worked as intended.
1: https://www.libertarianism.org/articles/battle-athens-obscur...
Back in those days quite a lot of Americans were moving west fighting coyotes and indians.
It doesnt help to pretend it was some noble freedom, or that America is an actual democracy today, because i highly doubt nobody in American wishes to build a ballroom or invade Venezuela.
America is a republic. Lots of Americans voted for the person doing those things.
Personally I believe capturing Maduro gave regular Venezuelans a chance to rebuild their country. Based on the parades and celebrations of expat Venezuelans living abroad many of them supported it as well.
I recently talked to an Iranian fellow who lamented his country's state, and was clear that he believed an armed population would let Iran get out of the mess it's in, but also would've prevented the mess in the first place.
Slaughterbots was a great way of illustrating the issue, but I think Daniel Saurez's "Kill Decision" talk is a lot more useful and more accurately predicts where we are today in issues of autonomous warfare and mitigation, despite being even older: https://www.youtube.com/watch?v=pMYYx_im5QI
He recommends an international framework where no human kill decision is left to be made autonomously (we're well past this stage), all robots announcing their presence and identification at all times where all citizens can track them, drones that patrol other drones not adhering to these requirements. That's where discussions should have started. Historically, it seems weapons have to be abused first to demonstrate how terrible they are, before treaties are enacted
Sorry what, we're going to have drones patrolling checks notes the Arabian Peninsula and also all of Eastern Ukraine, Crimea and Western Russia to make sure all sides' drones there are constantly squawking that they're on a bombing run? Do air-defense missiles and drones have the same obligation?
This sounds like a global no-fly zone. It's unclear the U.S. military can even enforce one over Iran.
As opposed to drones not announcing themselves, acting with impunity? Yes, I'd rather take the treaty that enforces this. You cannot simply "ban drones" or "ban robots" today, which is the point Daniel makes. You can only mitigate them
Creating a de facto global conflict no-fly zone is about as realistic as banning drones.
"Drones that patrol other drones" requires the resources of a no-fly zone.
> Not all robots are flying
No-fly zones are seldom maintained totally aerially.
> I'd encourage you to watch the talk
Will do. That said, I can't see any military power agreeing to have its drones (or air defenses) broadcasting like this.
I appreciate you watching the video and offering your counter perspective
I'm not loving his history of war and politics mapping feudal economies to armor and castles being broken by scale armies, which in turn enabled nation-states. We had massive armies before: Rome fielded them. Before them, Alexander the Great and phalanxes built scaled armies. The same breaking of armor, in fact, happened with chariots and long spears in the Bronze Age.
As for the threat to democracy, it seems professional armies allow leaders to separate themselves and their populations from the gory effects of war almost as effectively as AWS. Suarez also claims AWS will let leaders decouple population from power (a real concern, I think). But then he says it will permit anonymous war, which also means anonymous rebellion, which undercuts that first risk.
On AWS enabling offense over defense, meanwhile, we've seen that's currently dead wrong. The defender's advantage has grown. Not because air defenses are better. But because mass manufacturing cheap short-range munitions allows one to make their own territory lethal much faster than someone far away can bring their lethality to you.
In summary, I think Suarez offers a prescient and compelling summary of leading thought on AWS thirteen years ago. But he misses some marks. Internally contradicts at times. And as such, I'm not convinced in his proposed solution.
It does, however, contain a kernel of wisdom. Perhaps I could expand on it. Maybe what we need is open-source intelligence from space-based platforms that monitor, real time, the global airspace and ground for likely autonomous activity. What I'm proposing is a panopticon, but no more than Suarez's. It is, however, economically possible. And it could be enacted unilaterally. Knowing who is fielding what in what capacity will let us draw more thoughtful lines. It's not like we don't have a bunch of conflicts brewing as laboratories anyway.
0. FAA / ATC stuff
1. Adding self-guidance packages to any rocket to steer it to a specific spot will get attention very rapidly, because any tech info you disperse is going to be ITAR-controlled. This happened a couple decades ago to a few model rocket guys who added GPS targeting, and it happened again not too long ago to some dudes who published a youtube showing their flying widget with an onboard AI Decider/Navigator that flew itself back home. This is helped along by point 0, see above.
2. Your payload is an NFA "destructive device" no matter how you slice it. It's going to need a dozen or so grams of HE, and anything more than 7g OR any amount outside of a gun barrel is legally DD. Also, under Heller, the Second Amendment protects those weapons that are in “common use” by law-abiding citizens, and SC Bruen, SC Rahimi didn't scew with that, but no one is going to say that killbots are "common use" . . . which brings me to . . .
3. “Bearable arms.” - a doohickey that flies off, loiters and engages isn’t “borne” in any ordinary sense. This hasn't been tested in a court yet, but I would bet dollars to donuts that it doesn't come off like "quadcopter == bullet"
You could dodge some or all of these right up until the moment of deployment, but once you hook all the pieces together they're coming down on you like a load of bricks.
Oh no no no no they do not want their citizens/property to be getting their hands on stuff that can actually fight. Here, have an AR instead that you can cuddle.
Landmines are very effective. Likely one of the most effective for defending a long boarder with no natural geographic boundaries. and they are harmful (on purpose).
I mention it because some dangerous things are very effective deterrents. They may sound scary, but they are a lot better than any alternative.
Why would the world's most active and powerful armed forces sign anything banning the use of an effective tool?
Why to train your expensive robot to kill an anonymous child in a beach? is a bad use of your money when you can train it to kill a general in their house.
The only part that they didn't realized still is that using $10000 drones to launch bombs is also antieconomical and makes you look bad on TV. Eventually psychos will realize that the future is $500 mosquito drones delivering poison to one particular target. Much more digestible for the public opinion.
I hope that we are still at the moment to stop this future, but humans seem dumber and dumber by the day.
> I hope that we are still at the moment to stop this future, but humans seem dumber and dumber by the day.
You're living about 5 years behind if you think it's future. It's the present. There's nothing you can do to prevent it.
My bet is that warmongers will became suddenly reasonable when war will knock directly into their doors. In any case we'll need this money for the climate disasters that will just accelerate from now on. I wonder if this robots can be destroyed with a high pressure salt water stream, because for sure we will have plenty of saltwater in many of our cities.
People use robots (and soldiers) to dodge responsibility. By making the operator anonymous, hidden beneath layers of "chain of command", the fiction of "nobody was responsible" is conjured up.
By refusing to outlaw autonomous weapons, the absence of any human operator built-in, the US follows its greed, their wish for killing without remorse and the fiction of "untouchability".
Computers don't run without hardware, electricity and some kind of scope. Someone had input into that.
Reality cannot work in the way the books did, at least not with any type of computing architecture we've made so far. I'd go further and say it's antithetical to general intelligence and problem solving.
Genuinely unclear how this is different from the drones we've been fielding for decades. Or getting potted by a B-52 from BVR. Or firebombed.
And with these sorts of systems there will absolutely be a lot of civilians killed either due to the systems inability to distinguish between non-combatant and combatant or more likely the fact that shitty regimes simply don't value human live, their own country's or others.
Perhaps between nuclear powers. But we've already been doing set-piece battles as proxy wars without drones. Just other people.
At a certain point, you start hitting the other side's production. That means strikes on the homeland. Even if we're in a world where those factories are automated, that's going to result in errors and civilian deaths from time to time.
I'm also not saying any given country shouldn't build these things. We all do what we have to in order to survive. I think that's the reality, rather than any illusion that these things will make your people any safer.
Check out this video of Ukrainian drone narrowly avoiding a civilian: https://x.com/NAAF0Racoon/status/2118492156008841231
30 years ago, that guy would've been a barely visible smudge in a grainy video feed on a gunship's sight. He would've been killed because helicopter crew wouldn't have been able to tell that he was a civilian. With 2026 tech, they can properly identify him, steer the drone away just a few meters before hitting him, and fly down the road to hit the actual enemy group in the area. That guy survived only because modern weapons beam down high-def video and provide control link until the very end instead of just flying or shooting into the nearest heat source once a trigger has been pulled.
Why isn't there a chance for retaliation? Why couldn't we, you know, shoot back?
US drones today have to go through a long kill chain to decide if it can take action against a target. We’ve already seen this heavily eroded in Ukraine/Russia. It’s not hard to imagine to losing side removing the human element entirely with just a software flag.
My argument is that autonomous systems will move war so quickly that by the time you react and engage your systems as well the war will be over.
Comforting notion. Unsupported by any evidence.
This has been true of all ranged weapons, across history, over their weapon ranges. Which, since the advent of ICBMs, has been global. (And since when runaway auto-escalation has been a real concern–drones don't materially change that.)
So, what's the difference here?
Is it that killer robots are somehow not norm-breaking? There's something about how we imagine they will be that seems...okay for war? Versus poison gas, which somehow seems not okay for war to most everybody.
What do you think?
... and that there definitely won't be some horrific disaster where one (or many more than just one) such killer robots malfunction or run amok, or are taken over by malicious actors hellbent on causing exactly such a disaster.
Not because chemical weapons are immoral. Because they are ineffective, whereas landmines, cluster munitions and nuclear weapons are assumed to have future uses. Morality was never at issue, effectiveness was.
That has some big consequences, most of which are actually unpleasant. It means that efforts to ban ‘immoral’ weapons that are effective will likely never succeed. The model that activists thought they were building on is a foundation of sand – the only way you ban weapons is after they are basically useless anyway (to cut that point finer: you get to ban weapons after they stop being useful to the great powers, who may then enforce the ban on smaller states). The idea that we might summon up enough moral indignation to set these weapons aside seems unfounded. We are not nearly so moral as my high school teachers imagined, nor are we so cowardly as a ‘Fremen apologist’ might think. We’ve simply made an amoral calculation about effectiveness" [1].
[1] https://acoup.blog/2020/03/20/collections-why-dont-we-use-ch...
Maybe the argument is: given that the other guy will feel free to do it to me if I do it to him, NBC weapons aren't useful. Which is pretty much the same thing I was saying, it's a norm underpinned by not exactly mutually assured destruction, but something similar in the game theory.
Thinking about it first-order, it seems like at least nuclear and chemical weapons would be "useful". If the Soviets / Chinese weren't nuclear-armed and backing up North Korea / Vietnam, why not nuke 'em a bit to show them we mean business and get them to surrender that way? Holding other things constant, I bet that would have been the strategy.
(I think we're agreeing)
But on the flipside, Ukraine gave up it's nuclear weapons on a promise from Russia that they wouldn't invade.
I'm not even joking, almost every "ban on X" in the context of warfare happened after unspeakable atrocities where, once the dust settled, the parties involved looked at the sea of dead bodies and agreed not to do it again. I guess countries learn by doing.
Non-signatories include the US, China, Russia, India, Pakistan, Israel and Iran. And Ukraine decided to withdraw from the treaty after being invaded by Russia.
So a ban with a lot of signatories, but not by any means universal.
As far as nuclear weapons go, they haven't been banned but we have the non-proliferation treaty that worked to some degree. The use of nuclear weapons is also viewed as a line that after WW2 nobody has tried to cross.
The three South Korean soldiers recently injured raised awareness of the mines there, but they were patrolling an area with known risks.
The greatest issue in my mind for the past four decades or so are the very many civilian areas about the globe with scattered mines throughout areas where children ideally should be able to play and food grown safely.
* global distribution: https://www.statista.com/chart/26209/landmines-contamination...
* N-S Korea border discussion: https://www.lowyinstitute.org/the-interpreter/almost-a-milli...
https://en.wikipedia.org/wiki/Protocol_on_Blinding_Laser_Wea...
In other slightly related news, the US Secretary of State made mockery of International Criminal Court this morning. https://www.reuters.com/world/us/rubio-assails-international...
If Rubio finds that an offensive parallel to draw, then it shows how much he has bent his reality lens.
Not to be overly glib but that cat has been out of the bag for a long fucking time. Name a capability and I'll give you a conventional munition that has had said capability for over a decade.
What people should actually be worried about is an AI chain of command. The weapons are very secondary to the kill chain that initiates them.
I don't think I've ever heard of a landmine that autonomously hunts down it's target. AFAIK you gotta go to where it's been buried and step on it. A killer robot will come to you with or without your consent or any action or lack thereof on your part.
US international agreements aren't worth the paper they're printed on, so why not just lie?
The best defense is for your opponent's imagination to run wild.
It seems no one was responsible for Skynet.
AI/autonomous decision making absolves those being paid to be responsible of any responsibility. Can we at least save the ridiculous salaries that they're being paid to no longer make these decisions? It's becoming increasingly obvious that the decision makers are resentful of having to make decisions, and are jumping as quickly as possible to offloading it to "new, well marketed thing".
We're all Shaggy now. "Wasn't me".
US is the country providing weapons and being active in wars only they've started themselves. Otherwise not taking into account people life value, never in history.
> Washington maintains that existing international humanitarian law already applies to autonomous weapons and that a new legally binding treaty is unnecessary.
Sounds like diplomatic stalling
https://usun.usmission.gov/explanation-of-position-on-a-thir...
"We dissociate from preambular paragraph 13 because it inaccurately implies that sanctions are not in accordance with international law and pose a danger to food security and nutrition."
So essentially, we reserve the right to murder children by famine.
I suspect the "no" votes will coincide with the countries who stand to gain from the production or use of killer robots. And the "yes" votes will coincide with states that have nothing to gain.