I use the same and store the gpg private key in a yubikey neo.
The neat thing with yubikey neo is that I can use it with android phone using openkeychain and nfc. This pairs neatly with an app named password store that syncs my pass-database using git + ssh leaving my private key secure.