> One issue is that the domain needs to be with Go Daddy

Absolute dealbreaker.

There's no real reason why I can't just point my MX at them, do the additional configuration[*] and have them host my mail.

Any explaination would be pure (and utter) BS.

[*] being setting spf, dkim records and stuff