If you're wanting an end to end solution for something like this, you should check out https://github.com/marqo-ai/marqo. It handles all of this and it's entirely open-source too