Is it not non-deterministic by choice? A random factor added to prevent it from just choosing the deterministic most-likely next token.