People want to rent the pricey NVIDIA DGX H100. So Google just put it in their DC, letting customers pay its full price it every ~3 months; plus they don't have to operate it, which is win (or is it ?).
I also want to run my job on 5 DGXs for a month, not 1 DGX for 5 months.
they have to pay for the power and the staff to set them up/manage it
I wish that humanity gets to harvest static energy one day, so that everyone is able to run the experiments required in large-scale deep learning research, not only a handful of deep pocketed organizations.
You likely would not want to live in a future where every individual could each 'harvest' several gigajoules of 'static energy'.
Cue calls to reclassify balloons as assault weapons. /s
don't worry, smartest people I know are working on this problem.
On the other hand, liquid networks [0] seem promising in not requiring huge amounts of energy (by not requiring huge numbers of parameters).