This is why I leave my phone on silent 24/7 (no vibrate either).
If someone from my Contacts calls me, then I see the missed call and know to call them back when I have time. However I live my life on my time, nothing is ever so important I have to drop whatever I am doing to pick up someone else's call right away. You might say, what if there was an emergency? Well how many times has someone called you about an emergency where you could actually do something about it?
Maybe some have, but I bet most haven't.