Whilst this veers off-topic, I don't use the formal title, even though I have earned the right to do so. It's actually not just a matter if humility. I find that, when introduced with the title, people ask me for medical advice.
I am a mathematician, not a physician.
I think the opposite. It's unfair for medics without a PhD to be called doctor. If you have a PhD you've earned all the rights to be called doctor and to use the preffix whenever you feel like. I would if I had a PhD.