492 karma · joined April 20, 2018
I think it’s unlikely, but no less likely than the compute issues mentioned.
Chat as a search replacement is compelling, and one reason is for now it’s not monetized by ads. That may change, but Google’s stranglehold is materially weakened.
Of course I also enjoy some of the flexibility of WFH.
The delta of GPT3 -> ChatGPT is from the expanded context and control the model offers through fine tuning. Eg read the instructgpt paper to see the path on the way to ChatGPT.
While my CO2 spikes during cooking on gas, fortunately NO2 remains low. 5-15 ppb range. My gas furnace is in the basement, several floors away from my apartment.
Also I don’t think this is a Tell HN…
In terms of TPUs or other custom accelerators, sure, they exist. However most definitely aren’t building their own hardware.
ETA: I’m not saying power is irrelevant, it clearly matters. But saying it’s the dominant financial constraint is clearly wrong, at least below Google/Amazon/Apple scale. Never mind the cost of the people running these trainings!
Those A100 use 300watts each, plus let’s say 500watts for the rest. (8gpus300+500)8servers ≈ 25Kw * 8760 hours = 219k KwH / year. So if your costs are $0.15/KwH that’s only on the order of $32k/year.
Second, Anti-abortion people are ok with causing significant harm to women and see their lives as less valuable and not worth protecting.