You need to prove to us that modesty is an absolute quality. Reasonable people would agree that that is a bit extreme ("immodest") and that modesty is relative. (Try cheap instead of modest to see how this works.)
> There's no way in which a $6 million dollar house is "modest".
Relative to his wealth bracket he is being modest but not cheap.