Fine-tuning weights is easier than retraining the foundation model from scratch with a different corpus.

Source code makes it easier to modify a binary, training data doesn't make it easier to modify a trained network.