I've been using Mailvelope for a while, it's a good extension and works well. But yes, I share the same frustration regarding the private key storage in the browser.
Also, the problem is that you can't re-use the keyring from GPG, since they are using openPGP.js and the duplication is inevitable..