Changing the inequality is work in progress. Rather than feeling guilty, perhaps you could volunteer to help disadvantaged groups. Another alternative is to donate generously to appropriate charities.

From what I have read the homeless epidemic in SanFran is extreme, people sleeping rough, in broken down cars, etc. I am sure that wherever you go you will find people having it very tough compared to you.