For Nitrokey Start and Pro: Only during generation of key, it can be backed up.

The Nitrokey HSM supports encrypted backups of keys.