And in your hypothetical EV scenario, when you make the first restroom stop, there is no reason you can't do that at a charging station and top up, cutting some time off of your second refuel stop.
Another thing to consider, most people who get an EV can charge at home or at work, so they likely eliminate all gas stops during their day-to-day commutes. And that can add up to a lot of time savings (the optimistic refueling time is 5 mins, but I have had plenty take closer to 20 due to lines, traffic, out of the way, etc...). So yeah, maybe long trips require a little more planning, and a marginal amount of extra time, but it feels like nitpicking.