Given that costs for "consumer-ish" GPUs are rapidly rising, I wonder if you'd also have to distinguish two "tiers" of local inference by now: Cost if you bought the hardware a year ago and therefore already own it vs cost if you have to buy the hardware new.