I did not mean to say that an LLM knows literally all the publications. But the abstract knowledge is probably encoded in the weights.