Open weight models do more for AI safety than any other measure by far, as the most serious threath is never going to be misuse, but abuse of unequal access.
Agreed. Still not open data though, is it? i.e., we don't have access to the same data they used to train, which is useful for both finetuning and studying the model.
To be fair, this is part of the reason it is so valuable. Meta has access to absolutely stupendous amounts of private training data. If you forced them to make the data available you would have to settle for a tiny training set by comparison. The value of this is exactly that you are getting access to the result of training on data that you couldn't otherwise access at all.
In the model card they say they dont train on any user generated data