We are using dense_vector field that Elastic Search offers and it's scaling quite well.