> and that third person having access is always a compromise of my security that makes me more vulnerable to rogue actors.

You distill it well, a broken security solution is not a good security solution. Foreign intelligence services, "hackers", etc... they all want our trade secrets. We need real security systems to defend against them.