For me the biggest hurdle is absolutely not the manual setup process or the need to adjust things from time to time. Rather, it’s the fact that there doesn’t seem to be a simple, quick and reliable way to tell if my setup actually works.
How can I be sure that my email actually reaches its destination? That there’s no error in my DNS entries? That an obscure email service used by one of my clients doesn’t whitelist only major email providers? Can I be sure that things fail loudly when they don’t work?
I really hope I’m wrong and it’s possible to implement some kind of monitoring that tests my self-hosted setup and alerts me by SMS if something’s wrong with it.