If you want children, you should have children. They will be fine. If you deny yourself you will regret it later in life.