You can't inject the LLM if it doesn't see the data.
An architecture like this won't work in many situations, but it can work for a lot of simple questions.
And if you want the LLM to summarize things, you run an isolated instance that makes a summary and you never show that summary to the LLM that's following the user's instructions.