Hacker News Reader

I suppose that will tell you how confident it is, but not how confident you should be in what it says.

If it's deciding between two phrasings, I imagine the confidence you get will drop, even if the phrasings are equivalent.

You’re trying to get calibrated confidence, otherwise it’s less effective than you’d hope.

This approach with more data for calibration is basically the beginning of making a decision model like Jev.

You _can_ but you should not.