I use rsync via ssh for that scenario and I backup the stuff that isn't provided by the VPS, that is usually a list of installed packages, a dump or snapshot of the database and the relevant deployed files.