You need a small LLM that can reason very well and use tools like web search very well.
No one is going to compress human knowledge into few bits.
No one is going to compress human knowledge into few bits.
Information can only be compressed so much
And by then we’ll probably have been further surprised by just how much information and capacity for reasoning can be crammed into a few gigs of weights. Models just keep getting better for a given size, it’ll be interesting to see where the limit of that is.