Right now there is a stark difference between what smaller models can do and bigger models can do.
Smaller models are suitable for simple tasks like classification / summarisation while larger models are better in agentic capabilities.
Smaller models are suitable for simple tasks like classification / summarisation while larger models are better in agentic capabilities.