Anthropic is out with new nonsense about Claude
dair-community.social
dair-community.social
There is nothing "clear" about this. All we know is that the neural nets arrived where they are today, not by billion years of evolution, but by getting training on artifacts that resulted from those billion years of evolution. Does that mean they are the same or fundamentally different? How about we just admit that we don't know? Instead we pull out the "human exceptionalism" card again, which generally had a terrible track record throughout history, and helps absolutely nothing in gaining understanding.
In the places we traditionally acknowledge pain as a moral concern, without appeal to any kind of spiritual philosophy, we associate it specifically with non-verbal biological reactions and even then only in certain classes of life.
We recognize that some literary passage involving a character in pain is no more an occassion of real pain than when our child tells us about their imaginary friend's toothache or when an actor grips their chests and performs cardiac anguish on the stage. It can stir sympathetic feelings in us because we're social creatures who communicate through language and symbolism, but we share a sense that these are fictions of a different class than the real thing.
Claude presents as something closer to an amalgam of every character in digitized literature -- a fiction that cleverly exploits our social instincts -- than they do a living biological creature in which we acknowledge pain as a pressing ethical concern.
Maybe there's some future embodied AI that challenges this traditional understanding in a deeper way, but the language models transforming packets of short text passages remain profoundly far away from whatever that might look like.
Language is the I/O of the network, not the network itself. A human doesn't stop feeling pain just because we locked them in a box and reduced their interaction with the outside world to teletype. We simply don't know what's going on in the AI box.
> Maybe there's some future embodied AI
That changes nothing about the network itself. That just changes your perception of the network into something more familiar.
Most wouldn't readily accept that a Claude instance or a mysterious teletype smells lavendar just because it output a text that claimed to, even if it characterized the smell of lavendar through beautiful and relatable prose. Only if we had some independent reason to believe that it was capable of smell would we consider those words to be true testimony to the experience.
Pain, as widely used in matters of ethics, is in that class. We traditionally recognize it in some living bodies (only a rare few capable of language) and accept that, as living bodies, humans who communicate about it with seeming sincerity are very likely to be experiencing it. Although even then, we may remain suspect if their words are our only source of knowledge or if we have some deeper intuition about why those might not reflect a real happening.
And those are like vision, which LLMs are pretty good at. It's all just sensory information, 1s and 0s going into the network, which in turn change the behavior of the network in some way. Furthermore LLMs have demonstrated some form of vision even before we started training them on actual images, as could be seen by the crude vector graphics they were able to produce.
That single component of vision that you're talking about enables LLM's describe visual content, but in living creatures vision is a much more comlplex and multi-component system that can elicit non-verbal reactions like gaze aversion; cardiac or salivary or libidinous modulation; seizures and migraines; skin changes; etc
It's completely reasonable to believe that bioligical sense systems like vision or smell or taste or pain can be manifest in electronic systems. But one channel of "1 and 0s" being fed into even the most sophisticated language program isn't going to approach parity.
Like I said before, it's not unreasonable at all to have a discussion about analogs to more predominanently verbal faculties becoming manifest in these language systems, but there's a very profound and inescable reductivism being applied when you start to reduce environmental senses like pain or vision or touch to AI system as they stand today.
You can get away with that reductivism as a communicative metaphor for the sake of framing certain research endeavors, but you need to keep a handle on how thin that metaphor ultimately is. Anthropic is embarassingly/sophomorically eager to let go of it.
Nothing wrong with human exceptionalism, actually, if we exclude religion, human non-exceptionalism is risky to the point of insanity.
> How about we just admit that we don't know?
How about we admit that we do know? We do know that LLM's don't suffer and we do know that even if they do, it doesn't matter - we do know that animals suffer when they're killed for food, and?
Animals can express their suffering, LLM's cannot - because they don't suffer. If something hurts I don't feel it in my "neural network" I feel it at the point of contact or other organs whose functions are suppressed for very specific reasons. LLM's have no body, no organs, therefore no need to experience suffering. Suffering is a function specifically evolved for specific purposes, it's not an inherent property of all neural nets.
Artificial neural nets feel as much as a nail feels when struk by a hammer - no more. ANN's can fake feelings but they can't feel.
Whoever flagged it got what they wanted. Flagging generally kicks a submission right off the front page and limits the post's visibility.
After posting, it received a bunch of upvotes and comments. Within an hour or so of flagging, both pretty much stopped -- which achieved the goal of whoever flagged it -- to limit the discussion of this topic. I'll leave identifying the flagger's motivation as an exercise for the reader.
Anthropic bans 'abusive or cruel behavior' towards Claude
It's okay to have a strong opinion on this, but if you suggest the answer is 'clearly anything', I will start to suspect you haven't thought about the problem enough.
Yup, it really is.
It's the job of the media to scrutinize such statements and decide whether there's a story here at all (maybe the story is Anthropic researchers have fallen into a fantasy-land and brought many policymakers with them), not to just platform them.
You can run the AI on a Turing machine. Does the tape feel pain?
You can slowly do the operations with pencil and paper and generate the exact same slop as your Envydiahh GPU. Does the paper feel pain?
No, the only person feeling pain is the reader of the slop.
Two things can be true at the same time:
1) language does not feel 2) entity expressing the pain in language can
And separately, additional corresponding statements can also be true:
a) media may ( being generous here ) misunderstand what is being said b) media may report ( being probabilistic here ) the version that gets most clicks/views/whathaveyou c) humans will see themselves in tea leaves
I am not suggesting that you do not look at the abyss. I do think one has to be clear eyed about various incentives and restrictions some humans are subjected to.
edit:
Just in case you did not notice, the entire argument hangs on an adverb 'clearly', which should immediately suggest to all but most remedial readers that things are not clear at all, but author wants to move an inconvenient issue out of the way.