Anecdotally, I've found that it works much better for me if I only have notifications on for apps I care about and judiciously turn the rest off. I then leave my phone on vibrate because turning it on silent always lead to me wondering "What if someone tried to message me?" and checking it.

I like the idea of trying out airplane mode.