Wouldn't it be easier to eliminate yourself from the spectacle of watching the less fortunate. Because this type of thought process only comes from the "club seats" of world society. If you read actual studies on happiness, what the first world world categorize as fairly destitute aren't as miserable as we imagine. While we, with our fat bank accounts and our ever quest of acquisition, just aren't as happy as we seem to think we deserve. To quote The Big Lebowsky, "Fucking Nihilists".
If your goal is to minimise suffering, that's the only humane choice, barring friendly AI coming online.