We don’t need legislation to declare that a solid iron bar is not your mommy, but somehow not everyone is clear that LLMs are not people, and these immortal amoral simulations cannot be allowed to be confused with people.
But that does not matter anyway. We cannot allow informational entities to attain the same status as people, for exactly the same reason that we don’t allow people to hack voting systems to give themselves 1000000 votes. It would obviously completely destabilize human society.
The fact of declaring something a non-person does not prove it is a non-person. But in the case of LLMs we do know them to be informational structures that are in fact not people.
But that is not an argument or reason for anthropomorphizing every inanimate object. And if you want to draw the line somewhere, so that only some inanimate objects are people, then we have to argue about where to draw the line. The "but slavery..." argument only deals with actual humans, so it doesn't tell us that LLMs also get to be considered to be people.
Human slaves are embodied, and have a continuous consciousness from birth to death. LLMS have no bodies, cannot meaningfully be killed (to erase one is analogous to it leaving a particular location... it can still be in many other locations at the same time), do not experience pain, do not have emotions, and do not experience time (when you ask one a question it wakes up for a moment and then goes to "sleep" again after replying to you). You can't even meaningfully identify an LLM as an individual, since it was trained on the collective utterances of all humanity, and any little change to it makes it a different entity.