Using a simple back of the envelope calculation on energy requirements can tell you why. A 500km orbital altitude requires about 7.66 km/s of velocity. That's 29,337 kJ of kinetic energy per kilogram, and only 4,905 kJ per kilogram of potential energy. You don't perform an air-launch to for the potential energy savings: you do it for the reduced air-loads and energy loss due to drag from beginning your trajectory in a thinner atmosphere. This trade-off is almost never worth the added engineering complexity, as seen by vertical launch completely dominating the launch space compared to air-launch.
As for a balloon launch, well, balloons have absolutely dismal maximum payloads, so there's no way you're going to be able to hoist a vehicle with enough propellant to reach upwards of 7 km/s underneath a balloon.