It helps a bit more than you imply, though: if you can launch from a higher altitude, you have less atmosphere to plow through. That lets you use more of your propellant to speed up instead of to push air out of the way.