For occasional pgp use, a webapp is as easy as it goes. https://ssl.ba.net/util/pgp/

No need to store or remember keys, just create a new key for your conversation.

All encyption / decryption is done client-side with open source code.