I know the 'wow' factor is greatly lessened but I wonder if two sets of in-ear headphones wouldn't solve this problem easily. 20dB+ of noise isolation is not uncommon and the addition of bluetooth (or even a physical tether) to pipe sound between people would make conversation simple.
If I could get over the feeling that it would look incredibly out of place at a bar or restaurant I would pursue the matter further.