I could imagine that it will change the way you perceive things. There are experiments where people got goggles that switched the left and right eyes and people adjusted after a few days.
I don't understand why it would make any difference, from an evolutionary perspective, but apparently it does?