You cannot not care about part of the population, even if you think it's their fault they're not doing better. Because the day they go to the streets to tear apart society as we know it, is when it's too late to care about them. Sad but true, history has shown this is how it works.
Maybe it's extreme, but it's something to keep in mind. I had this very conversation with my grandpa the other day. He told me "well, you cannot care only about yourself, because you have to make sure other people/classes/whatever aren't so unhappy as to start a revolution."
I have very little sympathy for that idiocy. And even less for the decline of rugged individualism in favor of asking the government for handouts.
The lower class never had any advantages to begin with so my apathy does not extend there.