Reading all the comments here, seems like being able to run your own models is vital. If not, you are subject to a service where the capabilities are changing underneath you constantly and without notice.
Hooking them up to a good embeddings database (so the model doesn't hallucinate so much) is particularly tricky.