Yet someone will say that the solution was in the training data.

"LLM can't handle out-of-domain (OOD) queries!" Yeah.