It rarely affects me seriously. Sometimes the colour choices make them hard to distinguish: a red/green status light, a colour-coded chart etc.

It gets really hard when I must choose colours. I can't mimic colours I see, or pick a good colour palette.