It's not, it's a "public" key.
"Privacy: a secret matter."
"Privacy: freedom from unauthorized intrusion."
"Privacy: the quality or state of being apart from company or observation."
So you see, privacy IS security.
Not just any public key, it's your public key. It identifies you.