Predibase has a writeup that fine-tunes llama-70b to get 99.9% valid JSON out

https://predibase.com/blog/how-to-fine-tune-llama-70b-for-st...