The enjoyment of driving is not about human warmth, it's about control and adrenaline. I don't think the comparison makes sense. I'd be more excited about autonomous cars if I could turn it off in the country (as some cars today allow) for recreation.
I definitely agree with what you're saying—I know I'm probably in the minority for enjoying driving at all—but I frankly can't imagine anyone enjoying reading their credit card over the phone.