While not explicitly mentioned, why only openai api is supported? Folks with local LLMs feels left out.
We currently are running through LiteLLM, so while undocumented in theory other LLMs could work (in my experience they don't). I’m working on updating and fixing this.