Within a breeding population, height tends to follow a normal distribution. Depending on the standard deviation, there will be a few Japanese taller than the average Dutch. But there will be far more Dutch than Japanese among the very tallest men. This is a simple example, but in a sport where height matters, like basketball, there will be far more Dutch who are good at it than Japanese, and far more Japanese than pygmies.
Certainly culture matters, especially in sports where intelligence matters more and raw physical talents matter less. But genetics also matter.