I was formerly a data scientist with a salary 2x of what my current one is. I was miserable.
Today, I love work. I create things. I have two kids and a wife and she stays home with them and does actual tough work. I wear clothes from companies we partner with (sports science, so lots of universities give us free stuff) and company-logoed clothes only. I don't have expensive hobbies. My wife gets all of my money and I invest things at home like Blue Apron, a house cleaner, day care, etc, to make family life better.
Having a job I love and a company that fulfills my vision negated all need for tangible things in my life. When I was actually "rich" in regards to salary, liquid money, I was consumed by stuff. It was terrible.
Life's good now. I want for nothing expensive. I make this comment to tell you that you may be able to have both if your work is something that you truly enjoy.