What the leaks show is that the community can run circles around OpenAI and the others when it comes to optimizing these things and taking them in interesting directions on a shoe string budget.
For example of what one sesh of tinkering can produce:
https://github.com/geohot/tinygrad/blob/master/examples/llam...
https://www.youtube.com/watch?v=nctqc8FBJ2U&t=4954s
The cat is out of the bag, you don't need a beowulf cluster of A100's and unlimited Azure credits. You do need a budget to train that is out of reach for hobbyists but the moat is not insurmountable and I don't think VC's will be scared off anymore as a lot of startup ideas are viable and a lot of outsiders can demonstrably make a real go of it.
Time for BasedAI. Game on.