We are already doing it, as all LLMs are fully deterministic. So we are adding random seed to prompts and control temperature.
Actually, due to parallel execution they are not running deterministically. Even if the temperature is zero some randomness is left in. You can run a model deterministically, but this is incredibly slow.