Yeah, we just are good at seeing artifacts in human renderings, it can easily look wrong or uncanny. In contrast, if a boulder is rendered geometrically wrong we usually do not notice it.
It's people moving up or down on the screen relative to one another in a way which their relative distances wouldn't dictate. Agreed that it gives me an uncanny-valley feeling (still super cool though).