>if you ask LLM to sample a random number from 1 to 10, it will likely give you 3 or 7, as those are overrepresented in the training data.
I just tried this on GPT-4 ("give me 100 random numbers from 1 to 10") and it gave me exactly 10 of each number 1-10, but in no particular order. Heh