I’m certain the next big frontier model will also be able to improve the weights of comparatively tiny models. That does not improve the large frontier model.

Only the context window, right? Which seems....not that big of a hurdle to overcome or navigate around.