Self hosting puts you in control, which means you have potentially more safety so long as you manage risk. Physical custody of your data is very valuable. The metadata thing is more of a theoretical risk.
Embrace the fact that email is not ephemeral and can end up in the wrong hands from your perspective. The other party that you're communicating with is a far more likely leak than some rogue ISP or police action.