Wow, this is cool-- first time I've seen generating well formed output has been made easy, the use of Pydantic is clever/easy...
Which has lead me to the prior art: using same Pydantic API to generate structured output from local LLMs
https://github.com/outlines-dev/outlines?tab=readme-ov-file#...