Let's say you have $10M in in index funds. You don't want to cash out and pay capital gains, so you get a $5M credit line with your stock as a collateral. Then, there's a market crash, your collateral is all of sudden worth just $4M, and you have a bank knocking on your door - but you already spent $5M on a McMansion. Now what?
You can opt for "risk-free" assets, but then, if they're truly risk-free, they're probably not appreciating in a way that would make this tax gamble worth your time.