Even if that's true, they are still not reliable. The same question can produce different answers each time.
And even if it did, a certain degree of non-determinism is actually desirable. The most probable tokens might not be correct, and randomness is partly responsible for what humans interpret as "creativity". Even hallucinations are desirable in some applications (art, entertainment, etc.).
[1]: https://medium.com/google-cloud/is-a-zero-temperature-determ...