One trick I've recently adopted: I use this site:

http://mynoise.net/noiseMachines.php

In particular, the "babble" generator. The babble blends with actual conversations so you can no longer distinguish spoken words and reduces what would otherwise be attention grabbing conversations a to coffee shop level din.