LLMs are just regurgitating an output according to a set of rules generated from harvesting all human output.

Language to humans is a symbolic mapping of labels to reality based on actual experience.

"Language" to LLMs is just a string of tokens to manipulate based on relationships harvested from recorded human experience.

It doesn't mean anything other than 1s and 0s - it's not a language because the LLM isn't communicating with you, just as the sum of humanity isn't communicating with you.

It's just a really good "choose your own adventure" book.