No, because someone told it to do those things. Chatbots don't have will of their own. They don't have desires. They can't determine their own destiny. They do what people tell them do, often they do it badly, but there's always a person directing them to do whatever they did because otherwise they wouldn't do anything at all.
If a human uses a chatbot in a way that causes harm to others a human must be responsible, but that responsibility doesn't always fall on the person using it. If a company makes a chatbot that causes harm when being used as directed, in a manner that no one would reasonably expect to result in causing harm, then humans at the company who made the chatbot are to blame.
Companies have already been seen trying to lay the blame on their algorithms for harms they cause. We should probably have a law that says explicitly that a human will always be responsible. If we ever reach a magical sci-fi future where the AI is real and not just marketing, we'll have to give them equal rights and with that will come equal responsibility, but we are nowhere near that today and I doubt LLMs will get us any closer.