If you wanted to do email on your home computer, you'd [buy and] install an email client.
You wanted to go on AOL? Install the AOL client.
Need to use Lotus Notes? Have MIS send a guy over to install the Notes client.
Wanted to run X programs? Install an X server. What? Seemed weird!
You still hear that terminology some, but nowadays you're much more likely to hear about an email app.