I was in Japan, brought my wife and two kids with me, am 35 and am a single founder. Ha! Didn't need a visa though, but there are ways of making work if you do.
It's possible for sure, but definitely tough. My family came with me, but we were only together on the weekends. Without a doubt it was one of the hardest, most stretching, and most valuable experiences of my life.
If you hope to focus on the work as often as you can, I would recommend not bringing the kids. It can be done but boundaries need to be in place for your spouse/kids and your co-founders.
If you can stand to be away from them for more than a day. I can't.