Hacker News Reader

There is no such thing as extracting "task specific intelligence" into a cheaper model.

News to me. What do you call mixture-of-experts and model distillation?

those are still general purpose models. do you have an example of task specific model?