> Entropy-weighted similarity: We adjust the similarity scores between query tokens and related documents based on the entropy of each token.
Sounds a lot like BM25 weighted word embeddings (e.g. fastText).
Sounds a lot like BM25 weighted word embeddings (e.g. fastText).
If you're interested in this topic, I wrote an article on this method back in 2020: https://medium.com/towards-data-science/building-a-sentence-...