I have truly never understood this line of thinking. These two are not tied together.
I grew up in a car-centric city, but moved away in my teens. I've never personally owned a car and haven't had one in the household since I was 17. I hear this supposed "upside" of cars from my friends who are still stuck in LA, and what no one has ever been able to answer is:
What prevents you from renting a car when you want to drive out to the countryside? I drive out somewhere beautiful on a sunny weekend probably 3x as much as any of my friends who own cars, and I'm still paying less for total transportation than they do (let alone the occasional hassle that owning a car exposes you to). The only actual negative I can think of is the mental friction of having to pay each time, and this is just an irrational speedbump that really isn't that difficult to surmount.