Using multiple devices does not preclude one from using a server and end-to-end encryption.
Just curious if you do anything novel there.
With an HSM, it would have to be marked as exportable (bad for security), or to happen via some proprietary HSM to HSM cloning method endorsed by the vendor.
That said, I don't see that much HSM usage outside of the government or their contractors.