Perhaps one should start by looking into how the providers of LLMs obtained the training data.