Hacker News Reader

Comment by JasonFruit | Hacker News Reader

The moral decision is made by the person who released on their floor a semi-autonomous machine that cannot make moral choices. Calling this "robot morality" is idiotic, akin to saying that because an ax will indifferently cut a log or a human neck, it decides that cutting one is morally equivalent to the other.

View on HN

That was actually the article's point - by releasing this robot of death, you cede moral authority to it. Or by your reckoning, you make the decision to kill; the robot just disguises that fact.

But it's sensationally worded. That's true any time we take an action that may have unintended consequences, and what that action is — whether it's releasing a robot vacuum cleaner, striking a log with an axe, or writing a book with potentially dangerous ideas — is irrelevant. My point is that smart people say dumb things when recent technology is involved.

The idea is, we've not had robots to do our killing for us in the past. This is something new. You can kill (bugs in this case) without being present or even knowing its happening. Worth an article I think.

  The idea is, we've not had robots to do our
  killing for us in the past.

A bit of trivia I picked up in a robotics class: Most of the common definitions of 'robot' include cruise missiles, which we've had since the 1970s at least.

Setting out poison, traps, or mines, as we've done for centuries, is pretty similar; it's meant to kill in our absence, and can easily go wrong.

I think, though, that you're getting caught up in quibbling over choice of words and, in the process, missing the point of the article. It's not really advancing the conversation, it's just pedantry for the sake of pedantry.

There is an interesting difference, though it's not the one you've chosen to frame your comments around. It doesn't matter that the Roomba has no more moral agency than a sack of hammers. That's a point the author passes by on the way to the real crux of the article, which is that autonomous machines have a way of masking this fact in a way that tricks humans into ceding their own moral agency. That example of a person who wouldn't knowingly vacuum over a cricket but happily uses a Roomba is just a less politically-charged proxy for the question of autonomous military robots carrying weapons.

The point is that "unintended consequences" are much more likely with complex systems. When you wield an axe, the consequences are fairly direct. When you leave home for the 101st time after buying a Roomba, you are still responsible for the consequences, but they are much harder to keep track of.

Sensationally worded?!? You're saying there's a chance the headline "When Roombas Kill" could have even a single trait in common with linkbait? Outrageous!

This is a valid point, but there is another interpretation that once technology advances to the point that its pure magic to the general public, the general public can no longer have an intelligent discussion about the morality of their vacuum cleaner, they have to go all mythological, which occasionally is going to look pretty comical to the enlightened non-general public.

Or another way to look at it, is enough technological progress and specialization results inherently in a fragmentation of what morality means because the concept can't fit the same way in everyone's head (square peg round hole). Its a natural result that some fraction of the population will just meaninglessly babble while other fractions laugh. Its possible to interpret this has already begin with respect to evolution, geology/age of earth, climate change, stem cell research, euthanasia, gay marriage, etc...

> We’re going to have to figure out how to give machines moral codes even if it’s not something we want to think about.

The author of the linked article may want to read some Asimov.

Seriously, the roomba doesn't make a judgment about the insect because the roomba isn't making judgments about ANYTHING, it's just an extension of a human's choices, it just happens at a delay from when the human initially sets it up.

This is as much a question of morality, as saying that a vending machine that crushes an insect in its inner workings is a question of robot morality.

It's a question of morality in a philosophical sense, not as an application of science or engineering.

The roomba is capable of killing. Whether the operator is aware of this or not, when they use the roomba to clean their floor, they're ceding their moral agency to the device and to its creators.

The logic can be abstracted from the roomba to any other device. This creates the need for device operators, whatever the device, to examine the potential outcomes of device operation and potential assumptions and motivations of the device's creators.

Failure to examine the assumptions and motivations is the same as ceding moral agency, deciding not to decide and throwing hands in the air and saying "well, didn't see that coming" when the creator's assumptions and motivations play out in a way contrary to the operator's morality.

So, yeah, it's about a roomba killing a bug, or a vending machine spilling a soda. It's also about a facial recognition device not noticing a black guy on a black background, or a drone killing a dog because it's barking aggressively.

I'm sorry, I don't see those in any way the same. In both of your latter examples there IS a judgment being made by a form of AI someone built, there's a question there of someone building a tool that can act and decide things on its own. The roomba and the vending machine don't decide anything, they're just extensions of a human making a decision. That's not "robot morality" any more than it's "sword morality" or "hammer morality".

Right, in the case of the roomba and the vending machine, the human decision is 'turn on the roomba' and 'push the vending machine button'

The assumption of the roomba creator is that 'anything on the floor can be vacuumed, living or otherwise.' The moral choice, with regards to the life impacted by the roomba, is to disregard the potential value of the life. It's all debris.

The assumption with the vending machine is similar. The only value considered by the creator is in the transaction involving the operator's money and producing the material the operator wants. Anything else is considered without moral value.

Morality can be as much about the lack of value placed on something as it is about the value placed on something. I'm talking about moral agency, the implications of operating a device, and not about how a robot "feels" about doing something, for the lack of more accurate word.

"Guns don't kill people, people with guns kill people"

Reply on news.ycombinator.com