Isn’t their training subsidized by Microsoft? Sounds like Microsoft has the moat.
“Fifth, the board determines when we've attained AGI. Again, by AGI we mean a highly autonomous system that outperforms humans at most economically valuable work. Such a system is excluded from IP licenses and other commercial terms with Microsoft, which only apply to pre-AGI technology.”
The moat is still the cost.
That being said, most models are based on llama, so it may seem like a lot of movement is happening, but it’s not, really.
RWKV and deepseek are the only LLMs that’re fully open that I’m aware of.
If meta decided to stop releasing llama, that’s that.
Just because they share a near identical interface does not mean they will always have identical capabilities