It's electronic mail — just like e-book, e-signature, e-reader, e-ticket, e-file, e-learning, e-commerce, e-check, and so on. The lowercase "e-" prefix is broadly used and has a particular meaning.
The hyphen makes it read better, just like A-bomb, I-beam, O-ring, S-curve, U-turn, V-neck, or X-ray. Without the hyphen it looks like the stress should lean on the second syllable ("em-AIL"); "email" looks as awkward to read as "abomb", "ibeam", or "oring".
I know the ship has long since sailed on "e-mail". But to put it simply, it feels better to me.