I was able to break down the content into smaller prompts/completions. And remove some recurring and low-information data. Your suggestion of using embeddings to identify and feed relevant completions is pretty good. I'll try that soon.
https://github.com/openai/openai-cookbook/blob/main/examples...
Since I'm planning to use that for where i work, for the same use-case.
You get custom/fine-tuned models with Twig that only you have access to. You also get to train on private/behind-login information that is available to only your users.
Think of it as use-case-specific solutions vs generic solution.
Packaging it up as a nice widget that can be embedded on your site easily.
So you just upload your docs and have a snippet of JavaScript for your website that gives you a help bot.