Yes, we do. We know their design principles, their operation principles, the designs of specific instances, and everything else that has anything to do with "how they work inside". We know how they work inside. We know how they work inside and out.
What we can't do is predict their output, given some input (i.e. a prompt). That's because Large Language Models are so, well, large, and complex, that it's impossible to reproduce their calculations without ... a Large Language Model. In the same way, we can't predict the output of a Random Number Generator. Very much like a large language model, we know how an RNG works, but if we could predict its behaviour, then it wouldn't be working correctly.
But why is the inability to predict the behaviour of a complex system reason to imagine all sorts of mysterious and fantastical things happening inside the system, such as it "thinking", or "developing some kind of internal world model"? Those are not things that language models, small or large, are designed to do, and there is no obvious reason why they should be able to do them. There is no reason to assume they can do them either: the fact that they are models of language, trained to reproduce language, and nothing else, suffices to explain their observed behaviour.
There are no mysteries of intelligence, or artificial intelligence, to uncover in the study of large language models' behaviour. I am perfectly well aware that there are many people who absolutely want there to be such mysteries, there, and that will overlook everything we know about how language models actually work, to be able to fantasise about those mysteries.
But those are fantasies. They are superstitions. Superstitious beliefs about an artifact of technology, that we have created ourselves, and that some of us have now chosen to revere and wonder at as if it was an artifact of an alien civilisation fallen from the sky.
Also, on a personal note: not you too, Animats... come on, you're a knowledgeable one. Don't just get swept up in the crowd's madness like that.