Hacker News Reader

Comment by ulnarkressty | Hacker News Reader

Strong AI is a weapon. It will be regulated just like firearms/munitions - see the current EU draft which consists of some hundred pages of forbidding this or that under the guise of ethics and whatnot, after which comes a paragraph of "the above doesn't apply to law enforcement or military entities".

We're still in the early stages of this technology. ChatGPT will be to strong AI like a firecracker is to a BLU-109.

View on HN

I suspect it'll be more like strong encryption. That is, it will be "regulated" in some countries on paper, but readily accessible from the rest of the world with minimal effort.

Less like a BLU-109 and more like a Death Star. Every offensive and defensive military tool will be utterly defeated. How do you fight against a cloud of self contained autonomous kill drones?

Just look at what is happening in Ukraine with cheap drones precision dropping charges into open tank hatches and foxholes, and those are only basic off the shelf human steered drones! What happens when they are given a brain and advanced robotic abilities?

Nets, emp guns and chaff rifles

You have your drones. You also have your own personal chatbot that tells you when to ignore instructions from super-persuader AIs that would get you to kill yourself , spend all your money, or fall madly in love with an LLM if you didn't have a personal chatbot to protect you from their persuasive capabilities.

What if your personal chatbot was subverted by the super-persuader, or was controlled by it from the beginning? Impossible to be sure.

We're going to have to stop talking to machines.

> We're going to have to stop talking to machines.

Unfortunately that's going to limit us to talking to people physically in front of us. Society is going to be ugly soon.

Your personal chatbot to protect you will at first be a luxury and then be more of a commodity. It will run on your own machine. Right now you can run the big Facebook llama model on a single machine if you buy a $15,000 A100 with 80GB of VRAM. Churches, political parties and other moral associations will fine tune these chatbots based on their values.

If cheap drones dropping charges was enough to win the war then why does Ukraine need other weapons?

The current drones are limited in capability: can't reliably hit moving targets or assault infantry indoors, to start.

    see the current EU draft which consists of some hundred pages of forbidding this or that under the guise of ethics and whatnot, after which comes a paragraph of "the above doesn't apply to law enforcement or military entities"

That's not true though, is it? The section called 'TITLE II - PROHIBITED ARTIFICIAL INTELLIGENCE PRACTICES' is two pages long (https://www.europarl.europa.eu/RegData/docs_autres_instituti... page 44), and usage by law enforcement is under the condition that a judicial authority has to grant an exemption on an individual basis.

it's a good thing they've been so successful in regulating 3D printed guns then...

The question is where do we start setting the limits for regulations? I mean ya we ban nukes, but we also ban high powered layers and anti aircraft weapons. It's going to need limits in multiple dimensions.

Reply on news.ycombinator.com