This should be nice to be easier to integrate with things like Vanna.ai, that was on HN recently.
There a bunch of methods need to be implemented to work, but then usual OpenAI buts can be switched out to anything else, e.g. see the code stub in https://vanna.ai/docs/bigquery-other-llm-vannadb.html
Looking forward to more remixes for other tools too.