If the goal of training is to improve weights, training on output of the existing weights won’t improve anything, in fact the opposite may happen.
This is simply false. You are underestimating the utility of synthetic data and the ability to learn from the mistakes the current weights make.