This is not scientific in any way. when I'm exposed to sunlight for a long period of time without sunglasses, at night my eyes hurt.
I tend to think that pain is a way the body has to let you know something is not right.
I don't know if photokeratitis of the severity caused by normal outdoor activities has long-term consequences, but more severe UV exposure such as from welding without goggles can definitely cause permanent damage.