That's certainly true for many super-affluent people, but Warren Buffett is hardly the poster child. He lives a relatively modest lifestyle, and has already given away a large portion of his fortune.
Relevant Louis CK:
https://www.youtube.com/watch?v=lC4FnfNKwUo
I drive a cheap Honda Fit, not an Infinity, but the concept still applies to almost everyone who lives a decently comfortable western life.
Still, the charities he is giving his wealth to will get some of this benefit!