I'm impressed that you can go four hours between stops with a wife and kid in the car.
I think most people will find the stops to be more than they're used to, but not onerous. You'll probably hit 4-5 chargers in a day of driving. If you can time it right, two of those will coincide with meal breaks, so you're looking at 2-3 where you hit the bathroom, grab a snack, and maybe have to wait a bit on the car.
If you make big trips once or twice a year then it can easily be a net win over a gas car. The gas car wins on long trips, but requires ~15 minutes/month at gas stations even when you're just local. In my year of Tesla ownership, I'd say I've lost about two hours total waiting for a charge, and gained about that much not going to gas stations.