Milk isn't that commonly consumed. It's not like salt. You also don't want to overdo vitamin D.

https://www.sciencedirect.com/science/article/abs/pii/S00220...

https://www.theguardian.com/food/2020/jan/06/us-dairy-indust...