Two major issues are generalizability (or lack thereof, sometimes pretrained weights can even be detrimental to your specific tasks) and licensing (pertaining to the data used in the initial training)
I dont think the license of the dataset is relevant given it isnt being distributed or hosted. just the license of the weights. Happy to be corrected.
Suppose you produce a network whose weights can reproduce the content of the training dataset, as can happen. Are you saying that because it's just weights for a model, it can bypass the license of the data used to produce it and which can be reproduced by it?
If you’re using it at work then license of the training datasets absolutely matter, at least as far as lawyers are concerned (note that I am not a lawyer, I’ve just had to share this information with them in the past)