You can change that in Settings → Privacy and security → Invitations → Select My contacts
Bizarre that that's not the default and that it's actually an option at all.
This is a sensible default for most people. If it is no more, then settings can be changed.
When your name is out there in public channels things change. Just like with an email address