Hacker News Reader

>LLM’s are inherently non-deterministic.

I'm not an ML guy but I was curious about this recently. There is some parameter that can be tuned to produce determinism but currently it also produces worse results. Big [citation needed], but worth a google if it's of interest. Otherwise in agreement with your post.

View on HN

Temperature? Definitely tweaks the results…but I don’t know if “deterministic” is a term you can use in any way, shape, or form, in the context of LLMs.

https://www.ibm.com/think/topics/llm-temperature

Unless I’ve misunderstood something, setting a constant seed and a temperature of zero would give deterministic results.

Not good results necessarily, but consistent.

Reply on news.ycombinator.com