Modern VFDs have very high part-load efficiency and we can easily maintain a constant power characteristic through the full speed range by operating in the field weakening mode. One way or another you're losing energy in frequency conversion, it's just a question of whether you do that mechanically (with CVT) or electrically (with back-to-back converters).
Also keep in mind that for grid storage devices, we're usually talking about 500+ kW on each flywheel which, at low speed, is A LOT of torque.
You could store the energy in springs ala the da Vinci cart, but again not efficient.
All of these methods require a conversion, where as a Battery, Capacitor, or Leyden Jar will store DC as DC.
Flywheels aren't some hypothetical means of storing power, either - they've seen a lot of exciting R&D over the last 15 years, and there are operators of grid-scale flywheels. e.g. http://beaconpower.com/ http://en.wikipedia.org/wiki/Flywheel_energy_storage