I think your perception is stronger than the actual social effect - people who object to others not drinking are loud, but in my experience very much the minority.