I think the best would be to download also the entire wikipedia stored as embeddings. Seems like the best of both worlds.