You aren't supposed to be moving SSH keys. They should stay on the machine they were generated on. The less accessible they are the better.
I really wouldn't rely on an SSH key as the sole way of accessing a machine.
I really wouldn't rely on an SSH key as the sole way of accessing a machine.