This doesn't track at all, unless it is a safe assumption that the general trend of Bitcoin will always be up, and you are able to time the market to do any major withdrawals at higher prices. Or, you don't have any major withdrawals, and you luck out in that your many small withdrawals average out at a higher price.
None of that is guaranteed, and with Bitcoin's volatility, you're in for a bit of a ride every step of the way.
For people who have big Bitcoin hoards due to (say) mining back when mining was cheap, maybe they won't mind the swings so much since all of it is "free surprise money", but this doesn't really work for people who bought into Bitcoin in the last 5 years or so (either by buying coins with fiat currency, or by building expensive mining rigs and burning electricity).
(If you're solely talking about the first kind of person, then: apologies! In that case I think you're pretty much on the nose.)