> It's not too late.
I second that. A (male) friend of mine was 40 when they had their first child and now they have three.
More importantly: 39 is probably not too late biologically for your partner. A lot has changed over the last 20 years for late births.
Find a doctor who's competent and supportive to help you along, you're not the first people to have children at that age.
Turn your regret into a motivator. I've done a lot of different and exciting things in my life, I've lived on three different continents, worked with some of the smartest and most renowned people in their fields, and yet nothing beats the experience of loving your children.
Good luck.