You are on your own side quest to predict facial structure from genotype. That and perhaps intelligence agencies.
Your quest makes you concerned with discerning from averages. Outside your world, people don't have to be concerned with averages. Instead, they can see multiple correlated features. Perhaps a jawline, a brow, and a hairline.