Duplicity allows using gpg in a rather painless way:

  PASSPHRASE="myBackupGpgKeyPassphrase" duplicity ...

I use one gpg key per machine for backups, so having the passphrase in cleartext on that machine is not much of a problem.