Being ignorant of most religious things is socially not that big of a problem in my experience, you eventually miss some references in pop culture though.