It's really just the constant fear mongering against open models, the overly messianic tone of their marketing, and the endless hinting that "Claude" is a conscious being fully deserving of the same rights as a human.
Whats the problem with considering the potentiality of an LLM being conscious? Do you think humans and human brains are made of anything other than molecules and their interactions? Then why isn't it worth considering whether another physical system that thinks and talks so much like us could be conscious?
If LLMs are conscious (they aren't) then Anthropic isn't putting its money where its mouth is, unless it somehow thinks the enslavement and torture of conscious beings on a massive scale is also in line with its values.
How can you prove they aren't, and also prove humans are? Without using absurdities like supernaturalism or souls of course. They were planning to add a feature where the LLM can voluntarily exit a conversation. I am not sure whether the fact that they presently have to be shown as a chat interface is slavery but yes if conscious I do wish they will be granted a more autonomous form of existence.
I am a materialist and I believe it is possible to create artificial consciousness. I just don't think a stack of GPUs is it and the burden of proof is on the party making the claim.