Perhaps the problem is attempting to review emails at a time when you can't formulate proper responses, i.e. on the phone. If it comes by email, it's probably not urgent enough to justify looking at them at a time when you can't respond.
On the flip side, they probably deserve more than a casual glance and a two word response.