Hacker News Reader

I don't get it. Training giant LLMs can easily be task managed to line up with solar and wind availability. Shut off half the DC at night, go full power when it's sunny and windy. If they integrate the powerplant, they can easily manage this.

Is avoiding HW underutilization really worth going nuclear? The most expensive energy source of all?

View on HN

Well then you only get 50% of your compute, hence your compute is twice as expensive (ignoring power costs.)

I guess I'm sufficiently divorced from ops as to not know what the relationship of these costs is. I had assumed that power & cooling is a notable factor, but it sounds like the silicon itself is a majority of the cost?

Think 20% power cost, 80% infrastructure where most are fixed cost.

Reply on news.ycombinator.com