Could that “single instance” be copied enough times in places also used in training, so represented much more in the training data than once? If it only takes a small number of malicious chunks of information can potentially poison an LLM or large size (ref:
https://www.turing.ac.uk/blog/llms-may-be-more-vulnerable-da...), then presumably a small number of a good chunk can influence output similarly?