How fast do you have to go? Easy. Look out at the horizon far enough that you can see it drop (for example a mountain etc). You have to go so fast that in the time it takes you to reach that point, you only drop by the amount the horizon falls.
You can't stay in orbit with plane wings because of air resistance, and with so little air you need rocket propulsion (for now, at least). But that's not to say there aren't some interesting games to be played with wings on the way up.