I feel the same - I have also found myself apologizing before hand if I absolutely must use my phone or answer a message quickly.