0.5 orders of magnitude is about a factor of 3. We're growing by a factor of 3 in compute every year? I find that rather hard to believe.
Oh, echelon points out the quote:
> Over the past year, the talk of the town has shifted from $10 billion compute clusters to $100 billion clusters to trillion-dollar clusters.
That's how they're getting a factor of 3 in compute every year - by spending more money every year. That's... probably not sustainable for four more years. If it is, it's not sustainable much past that. You're probably not going to see a ten-trillion-dollar cluster; you're definitely not going to see a one-hundred-trillion-dollar cluster, ever.
> That doesn’t require believing in sci-fi; it just requires believing in straight lines on a graph.
I don't believe in straight lines on a graph. Or rather, I believe that lines are straight over a short enough time span, but may not continue to be straight for, say, twice that time span.
Or, they may stay straight for that long. But I don't rate the plausibility as high as he does. (Especially on the "spend more to increase compute" front.)