When LLMs are trained on text, are the words annotated to indicate the semantic meaning, or is the LLM training process expected to disambiguate the possibly hundreds of semantic meanings of an individual common word such as "run"?
Using models to generate/score/rank/modify data to be more useful as training data is a very interesting angle.