Except this is nothing like color blindness. No matter how much you play with colors, you remain colorblind. Colorblindness also affects your life at least somehow.

This is more like skill. The more you draw and deal with visual, the more your visual imagination and memory develops.

It is also completely irrelevant skill to day to day life, which would explain why bulk of population happily does not care about it at all.