This sounds very similar to:
https://github.com/wolfgarbe/SymSpell
Or maybe I am confused what you're saying. Are you trying to find more creative ways of saying the same phrase?
Or maybe I am confused what you're saying. Are you trying to find more creative ways of saying the same phrase?
The "surprisal" (information theory: Shannon information) component is doing statistical next word prediction. For example, given a corpus of data in which "data augmentation" is a common phrase, "da" could complete to "data augmentation".
"data augmentation" starts with "da", and would be determined as a likely candidate for the next word because it was common in the dataset on which the statistical model was "fine-tuned".
This Wikipedia page covers the concept in more depth: https://en.wikipedia.org/wiki/Information_content