Why would the gap grow? There is no more training data to acquire, frontier model are training on the entire internet. Everything from now on is just fine-tuning.
Your statement assumes training data is the only thing that matters for the big players, while not considering it limiting for the small Norwegian model. That’s a fallacy.
Nowhere in the article does it say the Norwegian LLM will train _only_ on Norwegian data.
Orders of magnitude less compute for pre- and post-training than the the frontier labs.