For many people, that meander will save them more money than they will earn in any other 10 minute slot of the day. And sitting in a robocab is smartphone media consumption time (or time for a printed newspaper, if you're a Vicky), it's not terribly hard to tolerate minutes that way. A well designed (and sufficiently dense in usage) shared autonomous car system could also support usage patterns a lot more dynamic than rigid door-to-door pickup: instead of sitting around idle, waiting for a car to divert into the cul de sac maze of their suburb, users might prefer a little walk towards the next through road, with the app auto-negotiating a rendezvous point. Not only because taking a little walk through your neighborhood is less annoying than sitting idle on call for pickup, but also because it would actually be faster. With that usage pattern, pickup overhead for the occupants would be much lower
I say "could" instead of "will" because all this is more a question of cultural development than a technological/economic one. If individual car usage does not go out of fashion, robotic driving will only continue the trend towards ever bigger commuter castles.