Do you have any resources that explain how saving money hurts others?
Money is like a loaded gun. It doesn't have to be fired. Just walking into a room waving one around will change the nature of most interactions.
You may as well say that taking any water out of the ocean is immoral because if all water was removed, the fish would die.