Excited to try this once y'all get self-hosting! Super useful that you'll also support structured output and openai style functions for models where it's not supported by the native API (that's been a big painpoint for breaking out of openai).
We also didn't think that our structured output support would be getting much buzz, but seems like there's some demand for a good solution there so we'll continue to invest in it.