"If you trained an LLM against all the recorded discussions of Einstein - is it that different from talking to Einstein himself?"

Yes, his daily visual, touch, hearing, smelling, readings... perceptions will be missing from the model.