That would almost certainly work to improve reliability but you would probably need something like this anyway, wouldn't you?
In general, it seems like building a production-ready LLM-based application requires _a lot_ of these little tricks and methods to hammer results into shape before sending them downstream.