When, and what was the bit?
Also: you've seen him live, right? How much did you pay for the tickets? Both times for me, the face was over $30, and both times the house was packed.
Do the math on how many shows he does. He tours constantly; a new one every year.
I don't think he's hurting. I think he's "only serious" when he jokes about having more money than everyone in the whole audience.