Is it possible you need other vitamins to utilize the higher levels of D, such as vitamin K? Or perhaps it's not vitamin D related but some other benefit of the sun?
Perhaps, I have heard about taking vitamin K with D and have tried supplements with both. You are right, maybe there is something else besides vitamin D. Maybe something to do with melanin production.