Two hours sucks compared to twenty seconds. It doesn't have to be you swapping the battery. Could be the pimple faced kid working at the gas station, or a robot.
Yes, it takes longer. But it happens while I'm sleeping, and requires no special trip. I do think swapping batteries will be the sensible way to handle this when we're also swapping cars, or when the cars drive us, unless charging times come way down.