I build these things for a living.
This is a solved problem.
You use multiple different types of models to supervise the worker models and force them to redo the work until you get a result that makes sense, or they fail and you give the resulting dump to a human to figure out what went wrong or ignore it.
Inference time compute is through the roof, but when you can save thousands of dollars by spending hundreds it's a no brainer.
Some people want AI to be as infallible as god before they'd consider it useful.