I think this is the key. Having a big fancy house usually comes with a big fancy mortgage, and who knows what his cashflow looks like. Did he invest his windfall and lose it? Did the tax man take it? Did his wife leave him soon after along with "half"? Any massive medical situations he's dealt with in his family? Is he heavily invested in a new project?
The claim is not that $6,000 is a hardship to him, just that it is not "a drop in the bucket". Ie, $6K is not an amount he would spend unthinkingly because of having so much money. Depending on where you live it's not odd to know people in houses worth over a million but who couldn't pick up a another car because the monthly payments would be too much. Technically they can afford it, but practically it's not "a drop in the bucket", so they have other priorities.