Hacker News Reader

Comment by harshreality | Hacker News Reader

What are authorities going to do when there's an image generation AI model that can output infinite amounts of CSAM? Are they going to keep trying to enforce these laws, which have good intent (at least by some advocates) but end up being a disaster that barely puts a dent in the problem, while massively increasing government power and decreasing privacy?

View on HN

I've used this example (CSAM-making AI models) as an illustration of the difference between ethics and morals many times. It would be theoretically ethical to use these models. It would, however, be immoral. Since governments are allergic to morality these days, it's going to get a lot worse before it gets better.

Why would it be immoral?

I think the argument is that the models are trained on real pics?

The other argument could be that it increases the chances of someone moving on from the consumption state to the abuse state.

The second part could also be the other way round. If there is easy access to CSAM maybe there will be less abuse. I could see either case be true, or that the availability of such material does not change incidence of abuse st all.

But having to train models on real materials is a major moral issue.

> The second part could also be the other way round. If there is easy access to CSAM maybe there will be less abuse. I could see either case be true, or that the availability of such material does not change incidence of abuse st all.

This is actually my opinion but I have no hard data on this. Is it feasible to apply the same logic as with video games where realistic killing is depicted and the argument is that this doesn't make people killers in real life?

Related (from today): https://news.ycombinator.com/item?id=37716928

South Korea has jailed a man for using AI to create sexual images of children

It's not new information that this kind of content is illegal, in many countries even if it's only computer-generated.

The issue is that hash-based scanning will be rendered irrelevant by AI-generated images because there could be an unlimited number of them, and they could be produced by general-purpose image generating software that isn't itself illegal.

Reply on news.ycombinator.com