That’s what Stability AI has been doing… There are already open source LLMs the size of GPT-3 such as OPT and Bloom