It’s because the models response is conditioned on the prompt. They are as intelligent as the person using them
In some sense it’s a lot like a google search. There’s this big box of knowledge and you are choosing tokens to pluck out of it. The quality of the tokens depends on how intelligent you are.