Hacker News Reader

Comment by rottencupcakes | Hacker News Reader

By allowing the monitoring of AI conversations, we are creating a dystopian world where essentially all recorded or spoken thought is monitored (given that AI has or will have access to almost all conversations).

Is this the world we want to live in?

View on HN

Like anything else online, if you want something to be private, don't post it.

Absolutely nothing you view, send or post on any online service can be assumed to be private.

If someone told you they were planning a mass shooting and wanted advice for how to carry it out, would you report them?

So do you think offline language models should be outlawed or restricted?

I don't know how you inferred that. I said nothing about restricting offline computing.

Ok, so the rules for someone who selfhosts vs. Hosts for others should be different? What if I provide inference services to my family members, should I monitor their interactions and report them if I find anything dangerous?

It's more about what I can expect.

If I keep a diary offline on paper I can expect that to be private.

If I keep a diary on a hosted diary-as-a-service, I cannot.

Many people have different expectations. Isn't that what this whole conversation is about?

You didn't answer my question.

No, I don't want to live in that world, and I would definitely read an article discussing how to ensure we don't reach that world.

That said, I think that world is quite a few steps away from the scenario being discussed, which is "when talking to X, X might report my conversation to the police".

You comment elsewhere that this might be a have vs have-not divide -- if you can afford to self-host a powerful LLM, you will have more liberties.

I think this isn't that trenchant of an observation for two reasons: (1) the wealthy have always had an advantage in exercising their rights over the poor, but more importantly, (2) the capability vs cost ratio of self-hosted LLMs continues to improve at an insanely rapid pace.

... and the advantage of the frontier models over anything you can possibly self-host continues to increase at an even more insane pace.

It's my perspective that open models are closing the gap faster than the frontier is widening it.

I'm not alone in that opinion.

By "open models", do you perhaps mean the approximately trillion-parameter open models that have been getting released recently? Because basically nobody can actually self-host those. And even at that size it's debatable that they're closing the gap.

Talk to me when you can do it with a 24B model quantized to 8 bits.

> Is this the world we want to live in?

Do you think you have a choice? It's Sam, Dario, and their investors' decision about what kind of world they want to build.

Reply on news.ycombinator.com