So all you're saying is we need log term context in LLMs and then we could have 'trillion' of unique LLM paths.

If that's the only limitation that you're putting forward than LLMs have already won over humans. If you're not hoping for some quantum level limitations then it's already over for us.