The way I see it, you have three options:
1. Apps that upload your contact list to their server to contact match (like WhatsApp, and others)
2. Apps that use your contact list locally to match (like Signal, and others)
3. Apps that work without your contact list and let you do it manually (like Signal, and others)
Are you looking for a fourth option? If so, what is it?
(Substitute other OSes as able.)
At some point it's a problem I'd like someone to be working on, but taking on a huge amount of individual burden for a low probability scenario isn't anyway to live life.
Heck, switching to Signal wasn't high on my agenda list until the Whatsapp TC change suddenly made my entire Facebook Messenger contact list worry about these things - and now I'm completely off Messenger, but it took collective engagement.