For NLP tasks it's unlikely that "epistemic uncertainty" is a useful metric, though it's interesting to ask an LLM "what is the third word in this sentence?" and then suggest alternative answers. It's a good way to demonstrate that an LLM is not really a "thinking" machine in the way laymen might assume.
Example:
https://chatgpt.com/share/e8743fe2-a604-4cf0-8c10-aa863a67a5...