Really interesting library! In the docs, could you describe in a bit more detail which kind of JSON errors it tolerates? And which models currently work best with your parsing approach?
- keys without strings
- coercing singular types -> arrays when the response requires an array
- removing any prefix or suffix tags
- picking the best of many JSON candidates in a string
- unescaped newlines + quotes so "afds"asdf" converts to "afds\"asdf"
In terms of models, honestly, we tried as bad as llama2, and it seems to work in quite a few use cases