I don't give to the homeless because I had a crap upbringing and I cling to my finances. My finances bring me a feeling of security. I don't know if that's selfishness. I wouldn't call it evil though.
What's the point of throwing around labels anyway?