Rather an extension to your logical argument (not disagreeing or agreeing): Either men should take paternity leave to let the women work or then they should support the family financially.
More generally: Having children costs something, because it requires work input. Who pays for the children? The men, women, families, their employers, the state (=also people who don't have children)?