(For reference, we banned ~10 users out of ~20,000. Not exactly ban-happy. I also believe that overzealous enforcement has a chilling effect.)
However, deleting somebody's email account for non-email offenses is a poor choice. The "offender" may be relying on that email address as a point of contact for family, to pay bills, etc. And community standards, while necessary, are unfortunately always going to be subjective to some degree.
Considering the large number of services that depend on an email address to determine one's identity... we need something else. I don't know the answer there. I should not lose access to my ability to pay my bills just because a forum moderator doesn't like what I say.