The problem is that saying that spending on hospitals and universities is "pissing money away" is much more sexy than saying that "in this geographic location and at this point in time, increasing the size of the campus will have a fairly low marginal value, whereas a larger marginal value could be achieved through other means."
For the record I, too, would have preferred that the money be put towards, for instance, mitigating existential risk. On the other hand, I'm very grateful to the people who funded the hospitals, universities, and public libraries from which I've benefited.