Conversely being on a bike there is a real sense that people in cars are out to do you harm. Theres the people who try to rattle you - honk their horn at you to vent their outrage, completely unaware of how fucking loud those things are, or run you off the road, that sort of thing. The real unnerving stuff is the people who come close to murdering you by accident, just not paying attention as they maneuver their vehicles. One time I made eye contact with a woman while I pulled my bike out from under her SUV (just a foot or two under, right between the wheels on the passenger side, real lucky break for me) as she sped away - people do hit and run but I never experienced it as a driver and don't think a car ever stopped to see if I was alright let alone exchange details when I was on a bike.
I never got the impression it was a class thing. I think part of it is that a bicyclist is not at all threatening and rather vulnerable in fact. The other part I suspect is just regular old 'not one of us' shit - if you listen to people they'll basically tell you how they think they should be allowed to wantonly mistreat bicyclists because they felt mildly inconvenienced at one point.