You will also need to account for the time to pre-flight the plane, and fuel it up, possibly wait on the taxiway, and possibly divert around weather (including to an entirely different airport if necessary).
Also, I have kids. They all puked in the car when they were babies, and needed sudden pee breaks when they were potty training.
You can't just pull over a plane.