You're not missing anything with FastMail. I started using it based on HN recommendations but eventually discovered its spam protection is too strict. It's not false-positive'ing emails into the spam folder, it's flat out rejecting them.
I've tried to work it with their support - who were responsive - but nothing has improved. I'm in the process of shifting providers, perhaps based on recommendations you get here.