GPT-4 has good json support now. It’s nice to be able to give it a a schematic get structured json back.
In between you may want some form of data storage, and natural language can be that as well, as it makes retrieval trivial for LLM.
It also feels like you can keep it more on track by telling it to put the data into specific fields with very specific descriptions.