Hacker News Reader

see the temperature parameter ? with current tech even if you set it to zero when you provide the same input multiple times you will rarely get the exact same output.

View on HN

The temperature parameter cannot be set to 0 via GUI, merely to a sall vale close to 0, as that would lead to a division by 0 in the code.

in proper implementation 0 means greedy decoding

yeah. because it's an LLM.

again, you are looking for an algorithm.

Reply on news.ycombinator.com