I had read this comment, but didn't read it under this lens. Thanks for (re)pointing me to it.
From the little I know about ML in general, you always want to introduce randomness so you don't get stuck in a local minimum/maximum. So they're all risk seeking?