>AFAIK only variance changes with sample size.

And what explains the change in variance as sample size changes?