I use sshfs. If you can login via ssh then you can mount the remote server through ssh as a local drive.
https://github.com/libfuse/sshfs
For added security I limit my home ssh access to a handful of trusted IPs including my cloud VM. Then I set up an ssh tunnel from my hotel through the cloud VM to home. The cloud VM never sees my password / key