This is one of those items where all there really is to say is refer to an xkcd.
People can define space any way they like, but I think "going to" space should require going at least 90% of the way around the world.
Which has the side effect of implying you've spent over an hour "in" space.