We are not pre-trained using the summary of all human knowledge over all of history. Yet we make certain decisions with much more ease.

We are much more limited, but we fundamentally work differently. Hence adding more parameter like certain companies are doing isn't necessarily going to help. We need to rethink how LLM work, or how it work in tandem with something that's completely different.

I think it's doable, I just don't believe it's LLM, and I don't think anyone now knows what it is.