Let's put this another way: every orbit is an ellipse. If you do not alter your orbit, you will only travel on the ellipse. The moment you stop interacting with the atmosphere, you are on a fixed ellipse. The problem is just behind you on the ellipse is the atmosphere, and if you continue forward on the ellipse you will inevitably come back to the part of the ellipse that is still in the atmosphere.