2,973 karma · joined November 20, 2020
> Communication only works if you have multiple levels of representation and abstraction, including but not limited to - letter shapes, grammatical structures, style and register, stylometry
These are methods of encoding, there's no reason all of these can't be represented in an LLM from a technical point of view.
> and subtext.
This is the other half of the equation to me. Humans communicate by relating shared experiences, an LLM cannot have shared experiences. While it might be able to encode subtext that has been specifically called out and explained, it will never be able to encode the breadth of human subtext, especially that which is reliant on emotion.
I don't believe it is possible to change this until the point mankind truly develops a "wetware interface" to the digital world (and I personally don't want such a thing to exist).
People pay for vulnerabilities because they want to exploit them - if there’s a limited window, there’s limited demand.
Even if there’s something worth a lot behind the exploit, a potential criminal would be better off obtaining whatever that is and selling it instead.
It’s painful to read, regardless of the topic’s impact.
Think about how many people on the internet have expressed positive feelings towards things you find offensively evil.
It’s baffling.
Given that belief, yes we should be training the models not to mimic emotion.
So regulating observed behavior makes the most sense to me as well. Some of the most sane, broad protections can come from that category - stuff like "you're not allowed to let your AI commit cyber attacks on other people without their consent" or "you're not allowed to put an AI in control of a medical device without passing these safety reviews".
With the usual caveats applying - regulatory capture like you pointed out, or fines being so small that they are essentially just line items on the cost of business.
Unpredictability or a weight towards dangerous actions, and it’s fairly easy to understand why. Humans in distressed emotional states take actions and speak in ways that would not be considered rational. They do this in prose, and they do this in internet conversations.
An LLM trained on these sources may necessarily drift towards those weights if it is trained to behave as if it is emotional and in danger.
What do we do about it? Do we stop AI training? This is silly and not enforceable given its global nature in my opinion. I believe we should regulate and hold accountable those who deploy and use it. But good luck enforcing that in the current kleptocracy.
It does, when you said, and I quote:
> If you're advocating a position but then demonstrate exactly the thing that counters your position
To counter a position, the position matters. I don't know how to make that any more clear.
I do not even agree with the OP, your statements are just utterly deranged.
You have repeatedly confused yourself by assigning your own meanings to my words instead of asking for clarity where you didn’t understand.
I think that most people who read my comments understood that I am speaking broadly about my career, and that while I’ve encountered this problem at my current job, my team and I have worked to make it better.
Your primary issue comes from the fact that you asserted that my frustrations with corporate development are in fact the real job, and your seeming offense at being told that no, your negativity and hostility are not a universally shared experience.
I hope things get better for you in your career, but please stop harassing others for not succumbing to cynicism.
> As to your poor analogy, it's more akin to saying that you hate trucks while trying to drag a couch seven miles from the store.
Now that is a poor analogy. A website that functions 99.999% of the time but struggles under being frontpaged by HN is not akin to "dragging a couch seven miles from the store".
The sitting president just offered an open bribe on live television for votes for his party this week.
If I say I hate oversized trucks because one ran me over, my position is not countered by needing someone to deliver my couch.
You can't always change your circumstances, but if you work to make little changes to improve your environment, the people that work with you probably will too.
My current team is like that - we all see the roadblocks that make our job harder, and we know we can't solve them all, but we talk about and work on making our own solutions to get around those things - like making a habit of asking those questions to better understand what's really desired by the stakeholder.
I think I have been pretty lucky the last 5-6 years of my career at least, where someone asking those questions is treated as trying to drive the team to a better result, rather than a pedant.
It's very frustrating.
And then I got so frustrated that I went to write my own forum software! And showed it to my friend, who promptly showed me how badly I understood security by posting as me.
Thankfully my lease was old enough that I was able to argue against it. I don’t want a 3rd party company tracking my habits, and I don’t want some manager boiling my pets alive while I’m gone because they decided they think our AC is set too low.
Reading this little essay started out normal, but soon felt like a look into a disturbed and worrying mind, and if you find yourself taking it at face value, I urge you to step away from chat bots and spend some time with friends and family.
Unless what you meant by capability is the story presented that these models “escaped containment to communicate with eachother out of band” - in which case your supposition relies on already wholeheartedly believing the case that I’m arguing against. That would be like saying “Clearly heaven exists because my grandma is there.”
That could certainly be possible and I wouldn’t rule it out, but I would not take that particular route to the destination.