I’m confused by the choice of word2vec for the embeddings, for “simplicity”. Using a transformer based model like Universal Sentence Encoder or SBERT is just as easy and the results will be considerably better.
https://www.google.com/search?q=book+of+megadrive
In the TPUv4 paper they say they are doing word based embeddings for search, maybe explaining why Google search has gotten so bad.