Why would LLMs need injected randomness to work effectively? Their nondeterminism isn't by design, it's largely a byproduct of how (batched) inference actually happens on hardware [0]. In case you are referring to the actual token sampling (be it temperature, Top-K or whatever), i wouldn't really see this as part of the LLM itself (And I've frequently seen benchmark sites run them at t=0 anyways)

[0] https://thinkingmachines.ai/blog/defeating-nondeterminism-in...