Next factor, what's your monthly debt payment, how much can your wife earn, and how cheaply can you live?
Entrepreneurship is usually light on cash income. I'm embarrassed to say that it took me 10 years of entrepreneurship before I got my first payout that could cancel out your debt. I'm probably in the slow class, and you'll probably not be as much of a dunce as me. But to be on the safe side, is your wife cool with enduring 10 years of uncertainty before buying a house and having kids?
You could pay that down more deterministically by finding a job in finance or another high-income / lower upside field. Really depends on what is right for you. I'm an advocate for the entrepreneurial path, and wish you the best of luck with it. Just make sure you and your wife understand the potential sacrifices.