Possible to get hypercalcemia from too much and hypercalcemia is not fun at all, speaking from experience.
Our ancestors in Africa got hours of sun exposure, and synthesized tens of thousands of IUs daily. How they managed to survive to reproductive age without getting hypercalcemia is a miracle! In fact, the very existence of our species proves that God exists. Given the dangers of hypercalcemia, that has to be the only explanation.
/s