The GPT-3 playground lets you view the probabilities of generated tokens. That's the closest thing to a confidence score you can get from a transformer model. But like the other person said, this isn't very meaningful.