Korea was only a Japanese colony for 35 years (1910-1945). After the Japanese occupation ended, the Koreans did their best to reject everything Japanese, so I don't think you can base your conclusion on that.
I don't deny that the Koreans do well in other sports, just that it's not like they have a cultural advantage or something. For example, their dominance in archery at the 2008 games was partially due to their building an exact replica of the Beijing archery range in Korea 2 years earlier and using it to practice. Many other competitors had never practiced on that archery range until they arrived at the Olympics, and it threw them off.