There are many examples in history (and in our modern world) where doing the "selfless" thing is just manipulation for serving someone else's interests first.
Religious leaders maintained power over society for ages by determining what was selfish behavior.
We likely cannot agree on a rule which always properly distinguishes between pursuing self interest for survival's sake versus crossing the line into harming others. Since we are forced to inhabit the same world, it's best to not disparage others for pursuing their own self interest as long as they aren't hurting you directly.