I am hopeful developments like Mistral (a 7B model with the performance of ChatGPT for most of the tasks I've used it for) keeps happening. Seems like we can still compress a lot of knowledge.