for the uninitiated:

LLM’s are not able to give confidence scores, they make them up.

Your AI driven app is making that up. Your product manager and executive team’s demand for confidence in the UI is a totally fictional cosmetic telling them nothing. Your company sold bullshit confidence to your clients.

I’ve done this for many organizations that “formed a new team to work with the CTO on their AI strategy”, and the trappings are the same

You can have an LLM tell you how much of a schema it was able to get information about. And derive a “confidence” or level of compliance from the completeness of the schema

But this is layers upon layers of cruft that a classification model wouldn’t need