It's much simpler than that. Drivers accept and then they cancel the ride themselves if they don't like the destination or the earnings. Normally you would penalize those drivers but I imagine with Lyft losing market share they likely can't afford to penalize drivers all that much.