> LLMs can be deterministic if you set the temp to zero.
At which point, you the major benefit statistical models like of LLMs…
A lot of performance is lost if you fix the sampling step like that as well.
That’s why nobody does it…
At which point, you the major benefit statistical models like of LLMs…
A lot of performance is lost if you fix the sampling step like that as well.
That’s why nobody does it…
No comments yet.