It's more about having the "fuck you" money. Once you reach this level, you typically have about $3-5M in various assets, so you don't have to work in order to keep paying your bills. You may want to work to buy that next supercar or yacht, but you don't have to.
So, if you are out of luck, you postpone that $5M waterfront summer home purchase, go sit on some board for symbolic money, sniff around, and eventually join some hot startup when you and your buddies found another investor cow to milk.
Not having to commit your time to a shitty offer in order to pay your bills right now makes a killing.