Why would you have private keys on the server? Those are passphrase-protected on your laptop/workstation.