Yes and that's the why you can't use multiple devices to access same environment. I highly recommend you to give linode + tmux + emacs/vim as an IDE.
However, the only problem I have convincing my teammates is that they use TextMate/Sublime, and that's the only thing that seems to break this, where Vagrant is potentially easier (you can share a local folder).
I tried things like rsync and fuse over ssh, but they seem a bit sluggish or not-so-transparent. I wish there was some tool that would solve this.