We absolutely should. But we should also have alternative ways for John Doe to get around without a car, and we don't.
Car culture in the US has started to evoke that old saw: "If you owe the bank a thousand dollars, you have a problem. If you owe the bank a billion dollars, the bank has a problem."
Our society would be a lot better off if we regularly revoked the licenses of unsafe drivers. But the entire nation is designed around car ownership, so doing that today would be an unconscionable human rights violation.