Couldn't you train multiple nets with somewhat different training sets, and for each classification see how many agrees?

If they all agree you have a high confidence, if they mostly disagree you have a low confidence.