If one assumes behavior is largely driven by physical/chemical/electrical processes within our bodies then this would not be surprising. Those processes are going to affect our appearances and being able to roughly assess those processes in somebody else from a distance would be a top tier skill that evolution would certainly end up selecting for.
A largely related example of this is smell [1]. I'm not referencing that particular study so much as the million other studies it also references and mentions early on. Our conscious appreciation of smell doesn't really reach much greater depth than "eww" or "aww", but there's a dramatically larger amount of subconscious processing that we do to come to that conclusion. For one fun example, men subconsciously rate the perceived attractiveness of a woman, based on a blind shirt sniff test, significantly higher when she is ovulating. Again, it's evolution baby. [2]
As a random thought, this also goes some way to explaining the uncanny valley. When the pieces don't fit together into a coherent whole, the brain simply rejects the lot of it.
[1] - https://cognitiveresearchjournal.springeropen.com/articles/1...
[2] - https://www.youtube.com/watch?v=aDaOgu2CQtI