If this paper is coming out of BAIR at a max 3B parameter model I suspect we'll quickly see much larger models from the industrial players. Hopefully Mistral takes an interest and releases an OSI licensed model.