Since M$ is doing away with simple free apps (such as Mail) and forcing users to move to cloud-based expensive apps, you can use FOSS (Free and Open Source) alternatives -- especially the Portable ones (e.g., apps from PortableApps.com) that don't need an install, they can run off a USB drive, and app+userdata can be easily backed up without fuss.
https://alternativeto.net/software/mail-calendar-people-and-...