Out of curiosity, why isn't "physical" storage used more?

Like pumping a bunch of water up high, or spinning a big ass flywheel.

I understand a flywheel might not be realistic at these scales, but water pumping seems like it could scale stupidly high.