You can still use the Gmail UI with a custom domain for free. All you need is a mail server. Once it's set up, configure a free Gmail account to fetch your email with IMAP and send from your domain with SMTP. Now you own your email but still get the Gmail UI as long as you want to use it, for free, with the option to use any other client you want as well.