Seeing a lot of comments in here about the token limits.
Another path you can take is to fine tune a model on your business. Each training item has to fit within the token limit, but you can send hundreds of megs of these for training.
It's more expensive to run a FT model, but you don't have to include any prior context (assuming it's common to all prompts).