No, it's a baseless assumption. You're somehow assuming that the only reason someone may even argue that you dont have to "neglect" your children and have a career is "only because they have money to out source their parental duties". That's a blatant baseless assumption. You may feel that, considering your career and the way you've been managing it, the only reason why someone may succeed in not neglecting their kids is if they pay someone else to do their job, but that obviously doesn't mean that your baseless assumption has any truth to it.
Simple math isn't worth anything if you get the facts all wrong.