HuggingFace will soon release their BigScience model: https://twitter.com/BigScienceLLM/status/1539941348656168961
"a 176 billion parameter transformer model that will be trained on roughly 300 billion words in 46 languages"
So anything smaller than that will become worthless. May be a factor, companies have a last chance to make a PR splash before it happens.
Read more about it: https://bigscience.huggingface.co/blog/model-training-launch...