It rings a bit false when juxtaposed with their $40b spend on the Metaverse…where was the savvy leveraging of the open source community then?
Meanwhile Meta’s competitors commoditise and glean profits from actually-SOTA LLM offerings.
In any case, their hypothesis is testable: which open source innovations from Llama1/2 informed Llama3?