Thats not how it works.

LLMs get you to average.

LLMs are not good at decision making under uncertainty.