Some background: This company's engine is based on its previous design, the SABRE engine. That engine is designed to reach an altitude at 28km, flying at Mach 5 (which works out to be about 1.5km/s at that altitude, ~15% of orbital velocity at LEO). After that the engine is designed to switch to a rocket mode, where it burns fuel and oxygen it brought, rather than taking it from the atmosphere.
Since the an air breathing engine is much more efficient (10x) than a traditional rocket engine, it allows the launch vehicle to conserve mass that would otherwise be used to overcome the high drag encountered in lower altitudes. You can roughly think of this as a rocket with all of its mass being launched at 28km, with a velocity of Mach 5 already.
"Getting out of the atmosphere" is a pretty vague statement. Atmospheric pressure and density is about 1-2% that of the ground. So drag at these altitudes will be less. However, some quick and dirty calculations by me makes this seem like a relatively small number compared to the amount of energy it takes to actually get to orbit. Quick search indicates the same as well[1].
However, a "thick" atmosphere is something that has to be dealt with. For example, rockets also need to overcome pressures that exists at lower altitudes. If you take a look at any rocket launch videos, you will notice that the exhaust at higher altitudes (typically about 2-3 minutes after launch) will expand outwards with respect to the rocket itself. This means that the flow out of the rocket engine is "underexpanded", making the engine less efficient than it would be otherwise. By starting your rocket engine at a higher altitude, you can improve the efficiencies by designing your rockets to lower atmospheric pressures (I don't know if this is done for the SABRE engine, but this is theoretically possible).
So based on these, the main motivation for this is probably for the mass savings and efficiency. Additionally, this engine presents itself with potentials for complete reusability, which is very attractive as most current launch cost is from the unrecoverable launch vehicle itself.
[1]: forum.nasaspaceflight.com/index.php?topic=9959.msg189860#msg189860