Attack surface. When you increase the number of parties capable of decrypting your data, you increase the risk of an exposure.