There is no such thing as a stable orbit “at sufficient distance to not be influenced by” gravity.
There’s no such thing as a sufficient distance.
I guess certain multi-body situations like Lagrange points might make it debatable about which "direction" you're falling though.
The GGP didn't say zero-g "is" falling. They said it's "the same as" falling. Which, for purposes of this discussion, it is, for the reason I gave--the key common property is being weightless, i.e., free falling.
Note, btw, that "free-fall" does not necessarily imply "downward acceleration". It just means "weightless". You could be weightless, in free fall, far out in deep space well away from all gravitating bodies, so that there is no well-defined notion of "downward acceleration" in your vicinity.