By hosting your main email on a custom domain(not a provider) you open a new attack vector for identity theft.
Someone can hijack your godaddy/namecheap/gandi account and point the MX DNS records of the domain to their own server and receive all your "Forgot your password? here is the link to reset!" emails
This a very bad advice unless you actually know what are the risks.